LUCENE建立索引时的问题

0 0

LUCENE建立索引时的问题0

代码如下

public void testIndex() throws IOException, SQLException {
		NewsDao ndao = new NewsDao();
		List<News> newsList = ndao.getNewsListAll();

		Analyzer analyzer = new IKAnalyzer(true);
		Directory directory = FSDirectory.open(new File(INDEX_DRICTORY));

		IndexWriterConfig config = new IndexWriterConfig(MatchVersion, analyzer);
		config.setOpenMode(IndexWriterConfig.OpenMode.CREATE);

		IndexWriter writer = new IndexWriter(directory, config);
		TokenStream ts = null;
		TokenStream content_ts = null;
		StringField idField = new StringField("nid", String.valueOf(0),
				Field.Store.YES);
		Document doc = null;
		for (News n : newsList) {
			doc = new Document();
			idField.setStringValue(String.valueOf(n.getId()));
			ts = analyzer.tokenStream("title", new StringReader(n
					.getNewsTitle()));
//			getTokens(ts);
			TextField title = new TextField("title", ts);
			content_ts = analyzer.tokenStream("content", new StringReader(
					HTMLFilter.delHTMLTag(n.getNewsContext())));
			TextField content = new TextField("content", content_ts);
//			getTokens(content_ts);
			doc.add(idField);
			doc.add(title);
			doc.add(content);
			writer.addDocument(doc);
		}
		if (ts != null) {
			try {
				ts.close();
			} catch (IOException e) {
				e.printStackTrace();
			}
		}
		if (content_ts != null) {
			try {
				content_ts.close();
			} catch (IOException e) {
				e.printStackTrace();
			}
		}
		writer.close(true);
		directory.close();
	}

在writer.addDocument(doc);时报空指针异常，我想获取每个Field的分词结果，所以使用TokenStream来创建Field，没想到居然出现这错误。小弟初学lucene，忘各位大神帮忙解决该问题。如果有其他方法可以在建立索引时返回分词也过也请告诉我，谢谢。

问题补充：错误提示如下：
Exception in thread "main" java.lang.NullPointerException
at org.wltea.analyzer.core.AnalyzeContext.fillBuffer(AnalyzeContext.java:124)
at org.wltea.analyzer.core.IKSegmenter.next(IKSegmenter.java:122)
at org.wltea.analyzer.lucene.IKTokenizer.incrementToken(IKTokenizer.java:78)
at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:102)
at org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:254)
at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:256)
at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:376)
at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1473)
at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1148)
at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1129)
at manage.lucene.LuceneTools.testIndex(LuceneTools.java:133)
at manage.lucene.LuceneTools.main(LuceneTools.java:95)