Uploaded image for project: 'SnappyData'
  1. SnappyData
  2. SNAP-1375

jvm crash with JDK 8 while inserting row in table.

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Priority: Highest
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 1.0.1
    • Component/s: Store
    • Labels:

      Description

      Host name: dev7
      OS name: Linux
      Architecture: amd64
      OS version: 3.10.0-327.13.1.el7.x86_64
      Java version: 1.8.0_121
      Java vm name: Java HotSpot(TM) 64-Bit Server VM
      Java vendor: Oracle Corporation
      Java home: /export/shared/software/jdk1.8.0_121/jre

      #####################################################
      Product Version: 1.5.3
      Source Date: 2017-03-06 20:55:04 +0530
      Source Revision: 06d54e72107926ff12eb3ec68f6c64d0b91f8ec7
      Source Repository: snappy/master

      Build Id: ssawant 030617
      Build Date: 2017-03-06 08:25:27 -0800
      Build Version: 1.5.3 ssawant 030617 2017-03-06 08:25:27 -0800 javac 1.8.0_121
      Build JDK: Java 1.8.0_121
      Build Platform: Linux 3.10.0-327.13.1.el7.x86_64 amd64
      #####################################################

      Test was run from /export/dev6a/users/ssawant/snappydata/store/tests/core/src/main/java/bin/../../../../../../tests/sql/build-artifacts/linux/classes/main/sql/sql.bt

      Test:
      sql/concMultiTablesUniqWithAccessors.conf
      A=store
      B=accessor
      accessorHosts=2
      accessorThreadsPerVM=8
      accessorVMsPerHost=3
      locatorHosts=1
      locatorThreadsPerVM=1
      locatorVMsPerHost=2
      storeHosts=1
      storeThreadsPerVM=1
      storeVMsPerHost=1

      Run with local.conf:
      hydra.VmPrms-extraClassPaths += $GEMFIRE/lib/jline-1.0.S2-B.jar;
      hydra.Prms-removeDiskFilesAfterTest = true;
      hydra.Prms-extraDerbyServerVMArgs += " -Xmx4096m -Dderby.storage.pageCacheSize=32000 -Dderby.locks.waitTimeout=30 -Dderby.locks.deadlockTimeout=20 ";
      hydra.Prms-extraDerbyServerVMArgs += " -XX:MaxPermSize=128m ";
      hydra.Prms-clientShutdownHook += sql.SQLTest dumpResults;
      //hydra.VmPrms-extraVMArgs += "-DDistributionManager.MAX_PR_THREADS=100";
      //hydra.VmPrms-extraVMArgs += "-DDistributionManager.MAX_FE_THREADS=100";
      //hydra.GemFirePrms-conserveSockets = fcn "hydra.TestConfigFcns.oneof(\"true\", \"false\")" ncf;
      //hydra.gemfirexd.FabricServerPrms-conserveSockets = fcn "hydra.TestConfigFcns.oneof(\"true\", \"false\")" ncf;
      hydra.GemFirePrms-conserveSockets = false; //per Suds, this is recommended to customers and should only test this setting now
      hydra.gemfirexd.FabricServerPrms-conserveSockets = false;
      //hydra.VmPrms-extraVMArgs += "-XX:+UseParNewGC";
      //hydra.VmPrms-extraVMArgs += "-XX:+UseConcMarkSweepGC";
      //hydra.VmPrms-extraVMArgs += "-XX:CMSInitiatingOccupancyFraction=50";

      //sql.SQLPrms-isSingleHop = fcn "hydra.TestConfigFcns.oneof(\"true\", \"false\")" ncf;
      //sql.SQLPrms-isSingleHop = true; //temp use

      sql.SQLPrms-dropProc = fcn "hydra.TestConfigFcns.oneof(\"true\", \"false\")" ncf; //whether there are concurrent ddl ops of procedures

      sql.SQLPrms-dropProc = fcn "hydra.TestConfigFcns.oneof(\"true\", \"false\")" ncf; //whether there are concurrent ddl ops of procedures
      hydra.VmPrms-extraVMArgs += "-XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=50 -XX:+CMSClassUnloadingEnabled";
      hydra.VmPrms-extraVMArgs += "-Dgemfirexd.critical-heap-percentage=90 -Dgemfirexd.eviction-heap-percentage=80 -Dgemfire.thresholdThickness=4.5";
      hydra.VmPrms-extraVMArgs += "-Dgemfire.eviction-thresholdThickness=8.1 -Dgemfire.HeapLRUCapacityController.evictionBurstPercentage=1.62 -Dgemfire.heapPollerInterval=50";
      hydra.VmPrms-extraVMArgs += "-Dgemfire.HeapLRUCapacityController.evictHighEntryCountBucketsFirst=false -Dgemfire.HeapLRUCapacityController.evictHighEntryCountBucketsFirstForEvictor=true";

      //randomSeed extracted from test:
      hydra.Prms-randomSeed=1488827031945;

          • Test failed with this error:
            CLIENT vm_4_thr_32_accessor2_dev7_17887
            INITTASK[18] sql.SQLTest.HydraTask_populateTables
            HANG a client exceeded max result wait sec: 600

      Found the following files:
      /export/dev7a/users/sagarwal/masterRegrLogs/sql/2017-03-06-09-33-47/concMultiTablesUniqWithAccessors-0306-110348/hs_err_pid17887.log

          • Last client logging by hung thread
            [info 2017/03/06 11:05:13.655 PST <vm_4_thr_32_accessor2_dev7_17887> tid=0x9c] insert into trade.securities (sec_id, symbol, price, exchange, tid )values (44, 'ffud32', 38.78, 'lse', 32)
          • Test declared hung 599755 ms after last client logging
            [severe 2017/03/06 11:15:13.410 PST <master_17635> tid=0x1] Result for vm_4_thr_32_accessor2_dev7_17887: INITTASK[18] sql.SQLTest.HydraTask_populateTables: HANG a client exceeded max result wait sec: 600

      Stacks not found for vm_4_thr_32_accessor2_dev7_17887

      From hs_err_pid17887.log
      #

      1. A fatal error has been detected by the Java Runtime Environment:
        #
      2. Internal Error (sharedRuntime.cpp:834), pid=17887, tid=0x00007fb64d1cf700
      3. fatal error: exception happened outside interpreter, nmethods and vtable stubs at pc 0x00007fb6e4a30e71
        #
      4. JRE version: Java(TM) SE Runtime Environment (8.0_121-b13) (build 1.8.0_121-b13)
      5. Java VM: Java HotSpot(TM) 64-Bit Server VM (25.121-b13 mixed mode linux-amd64 compressed oops)
      6. Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
        #
      7. If you would like to submit a bug report, please visit:
      8. http://bugreport.java.com/bugreport/crash.jsp
        #

      --------------- T H R E A D ---------------

      Current thread (0x00007fb5e000a000): JavaThread "vm_4_thr_36_accessor2_dev7_17887" daemon [_thread_in_Java, id=19750, stack(0x00007fb64d0cf000,0x00007fb64d1d0000)]

      Stack: [0x00007fb64d0cf000,0x00007fb64d1d0000], sp=0x00007fb64d1cb650, free space=1009k
      Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
      V [libjvm.so+0xac703a] VMError::report_and_die()+0x2ba
      V [libjvm.so+0x4fc3a9] report_fatal(char const*, int, char const*)+0x59
      V [libjvm.so+0x9c262a] SharedRuntime::continuation_for_implicit_exception(JavaThread*, unsigned char*, SharedRuntime::ImplicitExceptionKind)+0x33a
      V [libjvm.so+0x92a8fa] JVM_handle_linux_signal+0x48a
      V [libjvm.so+0x920b03] signalHandler(int, siginfo*, void*)+0x43
      C [libpthread.so.0+0xf100]
      j com.pivotal.gemfirexd.internal.impl.sql.compile.SQLParser.rowValueConstructor(Lcom/pivotal/gemfirexd/internal/impl/sql/compile/ResultSetNode;)Lcom/pivotal/gemfirexd/internal/impl/sql/compile/ResultSetNode;+34
      j com.pivotal.gemfirexd.internal.impl.sql.compile.SQLParser.tableValueConstructorList()Lcom/pivotal/gemfirexd/internal/impl/sql/compile/ResultSetNode;+2
      j com.pivotal.gemfirexd.internal.impl.sql.compile.SQLParser.tableValueConstructor()Lcom/pivotal/gemfirexd/internal/impl/sql/compile/ResultSetNode;+9
      j com.pivotal.gemfirexd.internal.impl.sql.compile.SQLParser.simpleTable()Lcom/pivotal/gemfirexd/internal/impl/sql/compile/ResultSetNode;+45
      j com.pivotal.gemfirexd.internal.impl.sql.compile.SQLParser.nonJoinQueryPrimary()Lcom/pivotal/gemfirexd/internal/impl/sql/compile/ResultSetNode;+41
      j com.pivotal.gemfirexd.internal.impl.sql.compile.SQLParser.nonJoinQueryTerm(Lcom/pivotal/gemfirexd/internal/impl/sql/compile/ResultSetNode;I)Lcom/pivotal/gemfirexd/internal/impl/sql/compile/ResultSetNode;+1
      j com.pivotal.gemfirexd.internal.impl.sql.compile.SQLParser.queryExpression(Lcom/pivotal/gemfirexd/internal/impl/sql/compile/ResultSetNode;I)Lcom/pivotal/gemfirexd/internal/impl/sql/compile/ResultSetNode;+13
      j com.pivotal.gemfirexd.internal.impl.sql.compile.SQLParser.insertColumnsAndSource(Lcom/pivotal/gemfirexd/internal/impl/sql/compile/QueryTreeNode;Z)Lcom/pivotal/gemfirexd/internal/impl/sql/compile/StatementNode;+103
      j com.pivotal.gemfirexd.internal.impl.sql.compile.SQLParser.insertStatement()Lcom/pivotal/gemfirexd/internal/impl/sql/compile/StatementNode;+70
      j com.pivotal.gemfirexd.internal.impl.sql.compile.SQLParser.preparableSQLDataStatement()Lcom/pivotal/gemfirexd/internal/impl/sql/compile/StatementNode;+162
      j com.pivotal.gemfirexd.internal.impl.sql.compile.SQLParser.StatementPart([Lcom/pivotal/gemfirexd/internal/impl/sql/compile/Token;)Lcom/pivotal/gemfirexd/internal/impl/sql/compile/StatementNode;+357
      j com.pivotal.gemfirexd.internal.impl.sql.compile.SQLParser.Statement(Ljava/lang/String;[Ljava/lang/Object;)Lcom/pivotal/gemfirexd/internal/impl/sql/compile/StatementNode;+8
      j com.pivotal.gemfirexd.internal.impl.sql.compile.ParserImpl.parseStatement(Ljava/lang/String;[Ljava/lang/Object;)Lcom/pivotal/gemfirexd/internal/impl/sql/compile/StatementNode;+62
      j com.pivotal.gemfirexd.internal.impl.sql.GenericStatement.prepMinion(Lcom/pivotal/gemfirexd/internal/iapi/sql/conn/LanguageConnectionContext;Z[Ljava/lang/Object;Lcom/pivotal/gemfirexd/internal/iapi/sql/dictionary/SchemaDescriptor;Z)Lcom/pivotal/gemfirexd/internal/iapi/sql/PreparedStatement;+1383
      j com.pivotal.gemfirexd.internal.impl.sql.GenericStatement.prepare(Lcom/pivotal/gemfirexd/internal/iapi/sql/conn/LanguageConnectionContext;Z)Lcom/pivotal/gemfirexd/internal/iapi/sql/PreparedStatement;+12
      j com.pivotal.gemfirexd.internal.impl.sql.conn.GenericLanguageConnectionContext.prepareInternalStatement(Lcom/pivotal/gemfirexd/internal/iapi/sql/dictionary/SchemaDescriptor;Ljava/lang/String;ZSLcom/pivotal/gemfirexd/internal/iapi/sql/compile/CompilerContext;Lcom/gemstone/gnu/trove/THashMap;)Lcom/pivotal/gemfirexd/internal/iapi/sql/PreparedStatement;+45
      j com.pivotal.gemfirexd.internal.impl.jdbc.EmbedPreparedStatement.<init>(Lcom/pivotal/gemfirexd/internal/impl/jdbc/EmbedConnection;Ljava/lang/String;ZIIII[I[Ljava/lang/String;JSLcom/gemstone/gnu/trove/THashMap;JI)V+113
      j com.pivotal.gemfirexd.internal.impl.jdbc.EmbedPreparedStatement20.<init>(Lcom/pivotal/gemfirexd/internal/impl/jdbc/EmbedConnection;Ljava/lang/String;ZIIII[I[Ljava/lang/String;JSLcom/gemstone/gnu/trove/THashMap;JI)V+26
      j com.pivotal.gemfirexd.internal.impl.jdbc.EmbedPreparedStatement30.<init>(Lcom/pivotal/gemfirexd/internal/impl/jdbc/EmbedConnection;Ljava/lang/String;ZIIII[I[Ljava/lang/String;JSLcom/gemstone/gnu/trove/THashMap;JI)V+26
      j com.pivotal.gemfirexd.internal.impl.jdbc.EmbedPreparedStatement40.<init>(Lcom/pivotal/gemfirexd/internal/impl/jdbc/EmbedConnection;Ljava/lang/String;ZIIII[I[Ljava/lang/String;JSLcom/gemstone/gnu/trove/THashMap;JI)V+26
      j com.pivotal.gemfirexd.internal.jdbc.Driver40.newEmbedPreparedStatement(Lcom/pivotal/gemfirexd/internal/impl/jdbc/EmbedConnection;Ljava/lang/String;ZIIII[I[Ljava/lang/String;JSLcom/gemstone/gnu/trove/THashMap;JI)Ljava/sql/PreparedStatement;+29
      j com.pivotal.gemfirexd.internal.impl.jdbc.EmbedConnection.prepareStatement(Ljava/lang/String;IIII[I[Ljava/lang/String;ZJZZZLcom/gemstone/gnu/trove/THashMap;JI)Ljava/sql/PreparedStatement;+204
      j com.pivotal.gemfirexd.internal.impl.jdbc.EmbedConnection.prepareStatement(Ljava/lang/String;)Ljava/sql/PreparedStatement;+27
      j sql.dmlStatements.AbstractDMLStmt.getStmtThrowException(Ljava/sql/Connection;Ljava/lang/String;)Ljava/sql/PreparedStatement;+4
      j sql.dmlStatements.AbstractDMLStmt.getStmt(Ljava/sql/Connection;Ljava/lang/String;)Ljava/sql/PreparedStatement;+4
      j sql.dmlStatements.TradeSecuritiesDMLStmt.insertToGFETable(Ljava/sql/Connection;[I[Ljava/lang/String;[Ljava/lang/String;[Ljava/math/BigDecimal;ILjava/util/List;Z)V+59
      j sql.dmlStatements.TradeSecuritiesDMLStmt.insert(Ljava/sql/Connection;Ljava/sql/Connection;IZ)V+209
      j sql.dmlStatements.TradeSecuritiesDMLStmt.insert(Ljava/sql/Connection;Ljava/sql/Connection;I)V+5
      j sql.dmlStatements.AbstractDMLStmt.populate(Ljava/sql/Connection;Ljava/sql/Connection;I)V+23
      j sql.dmlStatements.TradeSecuritiesDMLStmt.populate(Ljava/sql/Connection;Ljava/sql/Connection;)V+16
      j sql.SQLTest.populateTables(Ljava/sql/Connection;Ljava/sql/Connection;)V+49
      j sql.SQLTest.populateTables()V+69
      j sql.SQLTest.HydraTask_populateTables()V+3
      v ~StubRoutines::call_stub
      V [libjvm.so+0x690dd6] JavaCalls::call_helper(JavaValue*, methodHandle*, JavaCallArguments*, Thread*)+0x1056
      V [libjvm.so+0x99c357] Reflection::invoke(instanceKlassHandle, methodHandle, Handle, bool, objArrayHandle, BasicType, objArrayHandle, bool, Thread*)+0x5d7
      V [libjvm.so+0x99fa67] Reflection::invoke_method(oopDesc*, Handle, objArrayHandle, Thread*)+0x147
      V [libjvm.so+0x72447b] JVM_InvokeMethod+0x26b
      J 2098 sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (0 bytes) @ 0x00007fb6e51b82ed [0x00007fb6e51b8200+0xed]
      J 2097 C1 sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (104 bytes) @ 0x00007fb6e51bcacc [0x00007fb6e51bb940+0x118c]
      J 5757 C2 java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (62 bytes) @ 0x00007fb6e54e8044 [0x00007fb6e54e7fc0+0x84]
      j hydra.MethExecutor.execute(Ljava/lang/String;Ljava/lang/String;[Ljava/lang/Object;)Lhydra/MethExecutorResult;+91
      j hydra.MethExecutor.execute(Ljava/lang/String;Ljava/lang/String;)Lhydra/MethExecutorResult;+3
      j hydra.TestTask.execute()Lhydra/TestTaskResult;+12
      j hydra.RemoteTestModule$1.run()V+53
      v ~StubRoutines::call_stub
      V [libjvm.so+0x690dd6] JavaCalls::call_helper(JavaValue*, methodHandle*, JavaCallArguments*, Thread*)+0x1056
      V [libjvm.so+0x6912e1] JavaCalls::call_virtual(JavaValue*, KlassHandle, Symbol*, Symbol*, JavaCallArguments*, Thread*)+0x321
      V [libjvm.so+0x691787] JavaCalls::call_virtual(JavaValue*, Handle, KlassHandle, Symbol*, Symbol*, Thread*)+0x47
      V [libjvm.so+0x72cb00] thread_entry(JavaThread*, Thread*)+0xa0
      V [libjvm.so+0xa75543] JavaThread::thread_main_inner()+0x103
      V [libjvm.so+0xa7568c] JavaThread::run()+0x11c
      V [libjvm.so+0x926268] java_start(Thread*)+0x108
      C [libpthread.so.0+0x7dc5]

        Attachments

          Activity

            People

            • Assignee:
              sagarwal Sonal Agarwal
              Reporter:
              sagarwal Sonal Agarwal
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: