DATAtourisme

Problème chargement des données dans blazegraph

Bonjour,

J’ai un soucis de chargement des données en utilisant la commande
curl -X POST -H « Content-Type:application/rdf+xml » --data-binary @flux-10691-202105161037.rdf « http://localhost:9999/blazegraph/namespace/kb/sparql »

j’obtiens ceci :
Caused by: java.lang.OutOfMemoryError: Java heap space

Est ce que mon fichier es trop gros ?
Dois-je créer plusieurs flux ?

Merci

Bonjour,

Je tente de charger la base dans blazegraph sur ma raspberry pi sans succès.
Cela fonctionne sous windows.

J’ai ceci d’un côté :

pi@pi:~ $ java -Djetty.start.timeout=60 -server -Xmx800m -jar blazegraph.jar
INFO: com.bigdata.util.config.LogUtil: Configure: jar:file:/home/pi/blazegraph.jar!/log4j.properties

BlazeGraph(TM) Graph Engine

                   Flexible
                   Reliable
                  Affordable
      Web-Scale Computing for the Enterprise

Copyright SYSTAP, LLC DBA Blazegraph 2006-2016.  All rights reserved.

pi
Mon May 17 22:07:59 CEST 2021
Linux/5.10.17-v7+ arm
ARMv7 Processor rev 4 (v7l) Family null Model null Stepping null, null #CPU=4
Raspbian 11.0.11
freeMemory=3187880
buildVersion=2.1.6-SNAPSHOT
gitCommit=6b0c935523f5064b80279b30a5175a858cddd2a1

Dependency         License                                                                 
ICU                http://source.icu-project.org/repos/icu/icu/trunk/license.html          
bigdata-ganglia    http://www.apache.org/licenses/LICENSE-2.0.html                         
blueprints-core    https://github.com/tinkerpop/blueprints/blob/master/LICENSE.txt         
colt               http://acs.lbl.gov/software/colt/license.html                           
commons-codec      http://www.apache.org/licenses/LICENSE-2.0.html                         
commons-fileupload http://www.apache.org/licenses/LICENSE-2.0.html                         
commons-io         http://www.apache.org/licenses/LICENSE-2.0.html                         
commons-logging    http://www.apache.org/licenses/LICENSE-2.0.html                         
dsiutils           http://www.gnu.org/licenses/lgpl-2.1.html                               
fastutil           http://www.apache.org/licenses/LICENSE-2.0.html                         
flot               http://www.opensource.org/licenses/mit-license.php                      
high-scale-lib     http://creativecommons.org/licenses/publicdomain                        
httpclient         http://www.apache.org/licenses/LICENSE-2.0.html                         
httpclient-cache   http://www.apache.org/licenses/LICENSE-2.0.html                         
httpcore           http://www.apache.org/licenses/LICENSE-2.0.html                         
httpmime           http://www.apache.org/licenses/LICENSE-2.0.html                         
jackson-core       http://www.apache.org/licenses/LICENSE-2.0.html                         
jetty              http://www.apache.org/licenses/LICENSE-2.0.html                         
jquery             https://github.com/jquery/jquery/blob/master/MIT-LICENSE.txt            
jsonld             https://raw.githubusercontent.com/jsonld-java/jsonld-java/master/LICENCE
log4j              http://www.apache.org/licenses/LICENSE-2.0.html                         
lucene             http://www.apache.org/licenses/LICENSE-2.0.html                         
nanohttp           http://elonen.iki.fi/code/nanohttpd/#license                            
rexster-core       https://github.com/tinkerpop/rexster/blob/master/LICENSE.txt            
river              http://www.apache.org/licenses/LICENSE-2.0.html                         
semargl            https://github.com/levkhomich/semargl/blob/master/LICENSE               
servlet-api        http://www.apache.org/licenses/LICENSE-2.0.html                         
sesame             http://www.openrdf.org/download.jsp                                     
slf4j              http://www.slf4j.org/license.html                                       
zookeeper          http://www.apache.org/licenses/LICENSE-2.0.html                         

WARN : NanoSparqlServer.java:517: Starting NSS
WARN : ServiceProviderHook.java:171: Running.
serviceURL: http://192.168.0.60:9999


Welcome to the Blazegraph(tm) Database.

Go to http://192.168.0.60:9999/blazegraph/ to get started.
Processus arrêté

J’ai ceci de l’autre côté avec le curl

  pi@pi:~/Downloads $ curl -v -X POST -H "Content-Type:application/rdf+xml" --data-binary @flux-10691-202105161037.rdf "http://localhost:9999/blazegraph/namespace/kb/sparql"
    Note: Unnecessary use of -X or --request, POST is already inferred.
    * Expire in 0 ms for 6 (transfer 0xbaf8b0)
    * Expire in 1 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 1 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 1 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 2 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 2 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 2 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 2 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 2 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 2 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 2 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 2 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 2 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    * Expire in 0 ms for 1 (transfer 0xbaf8b0)
    *   Trying ::1...
    * TCP_NODELAY set
    * Expire in 149999 ms for 3 (transfer 0xbaf8b0)
    * Expire in 200 ms for 4 (transfer 0xbaf8b0)
    * Connected to localhost (::1) port 9999 (#0)
    > POST /blazegraph/namespace/kb/sparql HTTP/1.1
    > Host: localhost:9999
    > User-Agent: curl/7.64.0
    > Accept: */*
    > Content-Type:application/rdf+xml
    > Content-Length: 97628550
    > Expect: 100-continue
    > 
    * Expire in 1000 ms for 0 (transfer 0xbaf8b0)
    * Done waiting for 100-continue
    * We are completely uploaded and fine
    * Empty reply from server
    * Connection #0 to host localhost left intact
    curl: (52) Empty reply from server

Pourriez-vous me dire comment vérifier que la base est bien chargée svp ?

merci

Bonjour,

Vous devriez augmenter la mémoire dédiée à Java grâce aux paramètres :

-Xms512m -Xmx4g

Dans votre premier message, vous limitez la mémoire de Java à 800Mo, ce n’est clairement pas assez pour le chargement de l’ensemble des données du dataset.

Cordialement.