메뉴 건너뛰기

Cloudera, BigData, Semantic IoT, Hadoop, NoSQL

Cloudera CDH/CDP 및 Hadoop EcoSystem, Semantic IoT등의 개발/운영 기술을 정리합니다. gooper@gooper.com로 문의 주세요.


Jena 2.3를 Hadoop 2.7.2의  NFS로 mount하고 fuseki를 이용하여 start할때 오류 메세지이며
hadoop nfs에서 setattr을 지원하지 않아서 발생하는 오류임

--------------------------------------fuseki에서 발생하는 오류 메세지------------
-bash-4.1$ cat nohup.out 
FUSEKI_BASE : /svc/apps/sda/bin/apache-jena-fuseki-2.3.0
[2016-11-25 15:44:12] Server     INFO  Fuseki 2.3.0 2015-07-25T17:11:28+0000
[2016-11-25 15:44:12] Config     INFO  FUSEKI_HOME=/svc/apps/sda/bin/apache-jena-fuseki-2.3.0
[2016-11-25 15:44:12] Config     INFO  FUSEKI_BASE=/svc/apps/sda/bin/apache-jena-fuseki-2.3.0
[2016-11-25 15:44:12] Servlet    INFO  Initializing Shiro environment
[2016-11-25 15:44:12] Config     INFO  Shiro file: file:///svc/apps/sda/bin/apache-jena-fuseki-2.3.0/shiro.ini
[2016-11-25 15:44:12] Config     INFO  Template file: templates/config-tdb-dir
[2016-11-25 15:44:12] Config     INFO  TDB dataset: directory=/svc/apps/sda/bin/fuseki/mydb
[2016-11-25 15:44:12] Server     ERROR Exception in initialization: caught: BlockMgrMapped.segmentAllocate: Segment = 0
[2016-11-25 15:44:12] WebAppContext WARN  Failed startup of context o.e.j.w.WebAppContext@7dd712e8{/,file:/home/hadoop/svc/apps/sda/bin/apache-jena-fuseki-2.3.0/webapp/,STARTING}
org.apache.jena.assembler.exceptions.AssemblerException: caught: BlockMgrMapped.segmentAllocate: Segment = 0
  doing:
    root: file:///icbms#tdb_dataset_readwrite with type: http://jena.hpl.hp.com/2008/tdb#DatasetTDB assembler class: class org.apache.jena.tdb.assembler.DatasetAssemblerTDB

        at org.apache.jena.assembler.assemblers.AssemblerGroup$PlainAssemblerGroup.openBySpecificType(AssemblerGroup.java:138)
        at org.apache.jena.assembler.assemblers.AssemblerGroup$PlainAssemblerGroup.open(AssemblerGroup.java:117)
        at org.apache.jena.assembler.assemblers.AssemblerGroup$ExpandingAssemblerGroup.open(AssemblerGroup.java:81)
        at org.apache.jena.assembler.assemblers.AssemblerBase.open(AssemblerBase.java:37)
        at org.apache.jena.assembler.assemblers.AssemblerBase.open(AssemblerBase.java:33)
        at org.apache.jena.fuseki.build.Builder.buildDataService(Builder.java:74)
        at org.apache.jena.fuseki.build.Builder.buildDataAccessPoint(Builder.java:59)
        at org.apache.jena.fuseki.server.FusekiServer.configFromTemplate(FusekiServer.java:315)
        at org.apache.jena.fuseki.server.FusekiServer.initServerConfiguration(FusekiServer.java:263)
        at org.apache.jena.fuseki.server.FusekiServer.initializeDataAccessPoints(FusekiServer.java:211)
        at org.apache.jena.fuseki.server.FusekiServerListener.init(FusekiServerListener.java:71)
        at org.apache.jena.fuseki.server.FusekiServerListener.contextInitialized(FusekiServerListener.java:45)
        at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:799)
        at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:446)
        at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791)
        at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:296)
        at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1347)
        at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:743)
        at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:492)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:117)
        at org.eclipse.jetty.server.Server.start(Server.java:355)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:99)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:60)
        at org.eclipse.jetty.server.Server.doStart(Server.java:324)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.apache.jena.fuseki.jetty.JettyFuseki.start(JettyFuseki.java:120)
        at org.apache.jena.fuseki.cmd.FusekiCmd$FusekiCmdInner.exec(FusekiCmd.java:336)
        at jena.cmd.CmdMain.mainMethod(CmdMain.java:93)
        at jena.cmd.CmdMain.mainRun(CmdMain.java:58)
        at jena.cmd.CmdMain.mainRun(CmdMain.java:45)
        at org.apache.jena.fuseki.cmd.FusekiCmd$FusekiCmdInner.innerMain(FusekiCmd.java:96)
        at org.apache.jena.fuseki.cmd.FusekiCmd.main(FusekiCmd.java:59)
Caused by: org.apache.jena.tdb.base.file.FileException: BlockMgrMapped.segmentAllocate: Segment = 0
        at org.apache.jena.tdb.base.file.BlockAccessMapped.allocSegment(BlockAccessMapped.java:231)
        at org.apache.jena.tdb.base.file.BlockAccessMapped.getByteBuffer(BlockAccessMapped.java:157)
        at org.apache.jena.tdb.base.file.BlockAccessMapped.allocate(BlockAccessMapped.java:85)
        at org.apache.jena.tdb.base.block.BlockMgrFileAccess.allocate(BlockMgrFileAccess.java:50)
        at org.apache.jena.tdb.base.block.BlockMgrBase.allocate(BlockMgrBase.java:44)
        at org.apache.jena.tdb.base.block.BlockMgrWrapper.allocate(BlockMgrWrapper.java:46)
        at org.apache.jena.tdb.base.block.BlockMgrFreeChain.allocate(BlockMgrFreeChain.java:48)
        at org.apache.jena.tdb.base.page.PageBlockMgr.create(PageBlockMgr.java:51)
        at org.apache.jena.tdb.index.bplustree.BPTreeRecordsMgr.create(BPTreeRecordsMgr.java:79)
        at org.apache.jena.tdb.index.bplustree.BPTreeNodeMgr.createEmptyBPT(BPTreeNodeMgr.java:52)
        at org.apache.jena.tdb.index.bplustree.BPlusTree.createIfAbsent(BPlusTree.java:213)
        at org.apache.jena.tdb.index.bplustree.BPlusTree.create(BPlusTree.java:139)
        at org.apache.jena.tdb.index.BuilderStdIndex$RangeIndexBuilderStd.createBPTree(BuilderStdIndex.java:94)
        at org.apache.jena.tdb.index.BuilderStdIndex$RangeIndexBuilderStd.buildRangeIndex(BuilderStdIndex.java:65)
        at org.apache.jena.tdb.index.BuilderStdIndex$IndexBuilderStd.buildIndex(BuilderStdIndex.java:47)
        at org.apache.jena.tdb.setup.BuilderStdDB$NodeTableBuilderStd.buildNodeTable(BuilderStdDB.java:72)
        at org.apache.jena.tdb.setup.DatasetBuilderStd$NodeTableBuilderRecorder.buildNodeTable(DatasetBuilderStd.java:423)
        at org.apache.jena.tdb.setup.DatasetBuilderStd.makeNodeTable(DatasetBuilderStd.java:323)
        at org.apache.jena.tdb.setup.DatasetBuilderStd.buildWorker(DatasetBuilderStd.java:204)
        at org.apache.jena.tdb.setup.DatasetBuilderStd._build(DatasetBuilderStd.java:198)
        at org.apache.jena.tdb.setup.DatasetBuilderStd.build(DatasetBuilderStd.java:187)
        at org.apache.jena.tdb.setup.DatasetBuilderStd.create(DatasetBuilderStd.java:91)
        at org.apache.jena.tdb.StoreConnection.make(StoreConnection.java:228)
        at org.apache.jena.tdb.StoreConnection.make(StoreConnection.java:235)
        at org.apache.jena.tdb.transaction.DatasetGraphTransaction.<init>(DatasetGraphTransaction.java:73)
        at org.apache.jena.tdb.sys.TDBMaker._create(TDBMaker.java:58)
        at org.apache.jena.tdb.sys.TDBMaker.createDatasetGraphTransaction(TDBMaker.java:46)
        at org.apache.jena.tdb.TDBFactory._createDatasetGraph(TDBFactory.java:82)
        at org.apache.jena.tdb.TDBFactory.createDatasetGraph(TDBFactory.java:64)
        at org.apache.jena.tdb.assembler.DatasetAssemblerTDB.make(DatasetAssemblerTDB.java:57)
        at org.apache.jena.tdb.assembler.DatasetAssemblerTDB.createDataset(DatasetAssemblerTDB.java:48)
        at org.apache.jena.sparql.core.assembler.DatasetAssembler.open(DatasetAssembler.java:45)
        at org.apache.jena.assembler.assemblers.AssemblerGroup$PlainAssemblerGroup.openBySpecificType(AssemblerGroup.java:130)
        ... 32 more
Caused by: java.io.IOException: 부적절한 인수
        at sun.nio.ch.FileDispatcherImpl.truncate0(Native Method)
        at sun.nio.ch.FileDispatcherImpl.truncate(FileDispatcherImpl.java:80)
        at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:905)
        at org.apache.jena.tdb.base.file.BlockAccessMapped.allocSegment(BlockAccessMapped.java:223)
        ... 64 more
[2016-11-25 15:44:12] Server     INFO  Started 2016/11/25 15:44:12 KST on port 23030



----------------------------------------hadoop nfs에서 발생하는 메세지-----------------------------------------------
-bash-4.1# 16/11/25 17:59:49 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:50 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:51 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:52 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:53 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:54 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:55 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:55 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:56 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:57 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:58 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:59 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when setattr, fileId: 1128904
16/11/25 18:00:01 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:02 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:03 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:04 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:05 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:06 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:07 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:08 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:09 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:10 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-17108183
번호 제목 날짜 조회 수
58 update를 많이 하면 heap memory가 많이 소진되고 최종적으로 OOM가 발생하는데 이에 대한 설명 2017.04.10 817
57 LUBM 개수별 hadoop HDFS data사이즈 정리 2017.04.06 210
56 protege 설명및 사용법 file 2017.04.04 3017
55 fuseki가 제공하는 web ui를 통해서 dataset를 remove->create할 경우 동일한 동일한 이름으로 지정했을때 fuseki-server.jar가 뜨지 않는 현상 2017.02.03 469
54 https://github.com/Merck/Halyard프로젝트 컴파일및 배포/테스트 2017.01.24 181
53 federated query 예제 2017.01.19 298
52 Halyard - RDF4J와 Apache HBase를 이용하여 구현된 TripleStore이며 SPARQL 1.1쿼리를 지원한다. 2016.12.29 733
51 jena의 data폴더를 hadoop nfs를 이용하여 HDFS상의 폴더에 마운트 시키고 fuseki를 통하여 inert를 시도했을때 transaction 오류 발생 2016.12.02 170
» Jena 2.3를 Hadoop 2.7.2의 NFS로 mount하고 fuseki를 이용하여 start할때 오류 메세지 2016.12.02 1641
49 S2RDF를 이용한 다른 버젼의 github링크 2016.12.02 272
48 데이타 분석및 머신러닝에 도움이 도움이 되는 사이트 2016.11.04 433
47 How-to: Build a Complex Event Processing App on Apache Spark and Drools file 2016.10.31 358
46 동시에 많은 요청이 endpoint로 몰려서java.net.NoRouteToHostException가 발생하는 경우의 처리방법 2016.10.17 654
45 프로그래밍 언어별 딥러닝 라이브러리 정리 file 2016.10.05 312
44 모두를 위한 머신러닝과 딥러닝의 강의 file 2016.09.27 395
43 특정문자열이나 URI를 임의로 select 절에 지정하여 사용할때 사용하는 sparql 문장 2016.08.25 453
42 jena jar파일실행시 org.apache.jena.tdb.TDB.init에서 java.lang.NullPointerException발생시 조치사항 2016.08.19 401
41 Jena는 기본적으로 multi thread환경을 지원하지 않는다. 2016.08.16 310
40 [Elephas] Jena Elephas를 이용하여 Spark에서 rdfTriples의 RDD를 만들고 RDD관련 작업하는 샘플소스 2016.08.10 202
39 슬라이딩 윈도우 예제 2016.07.28 181
위로