This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

Some services missing/not running after upgrade of appliance from 8.2 to 8.5

After some initial troubles, I have managed to upgrade three sentinel appliances from 8.2 to 8.5, but I seem to be missing some services on the sentinel server.

Perhaps some of you out there can help me locate them?

My collector manager is trying to send event to the sentinel server on port 61616. It seems this should be an ActiveMQ instance, but nothing is currently running there and I don't see a clear service to start it?

Could someone with a functioning system (8.5 is possible, but I guess any 8.x version will do) check what is responding on that port and see if they can locate the service and/or package that is responsible?

I think I might save a current snapshot and momentarily revert to before OS upgrade to see if I can find the files there, but any help would be appreciated.

There might be other services that should be running but are not. This is the most obvious one from the logs, though.

Parents
  • 0

    Looking into an activemq directly from Apache...

  • Verified Answer

    +1   in reply to 

    ActiveMQ runs embedded in the main Sentinel process.

    sentinel:~ # lsof -i :61616
    COMMAND   PID   USER   FD   TYPE  DEVICE SIZE/OFF NODE NAME
    java    12948 novell  374u  IPv6 2293196      0t0  TCP *:61616 (LISTEN)
    
    sentinel:~ # ps ww -p 12948
      PID TTY      STAT   TIME COMMAND
    12948 ?        Sl    54:55 /opt/novell/sentinel/jdk/jre/bin/java -Dsrv_name=Server -server -Desecurity.home=/opt/novell/sentinel -Desecurity.data.home=/var/opt/novell/sentinel -Desecurity.config.home=/etc/opt/novell/sentinel -Desecurity.log.home=/var/opt/novell/sentinel -Desecurity.dataobjects.config.file=/xml/BaseMetaData.xml,/xml/WorkflowMetaData.xml,/xml/ActMetaData.xml -Desecurity.service.plugin=esecurity.util.service.ContainerService -Dcom.esecurity.configurationfile=/etc/opt/novell/sentinel/config/configuration.xml -Djava.util.logging.config.file=/etc/opt/novell/sentinel/config/server_log.prop -XX:+HeapDumpOnOutOfMemoryError -Xrs -Desecurity.sentinel.terminationTimeout=0 -Desecurity.sentinel.gracefulShutdownTimeout=30000 -XX:OnOutOfMemoryError=kill -9 %p -Desecurity.communication.service=Server2 -XX:MaxPermSize= -XX:+UseG1GC -XX:HeapDumpPath=/var/opt/novell/sentinel/log/Server.hprof -Duser.language=en -Dsentinel.securitymode.fips=false -Dfile.encoding=UTF8 -Desecurity.cache.directory=/var/opt/novell/sentinel/data/server.cache -Djava.security.auth.login.config=/etc/opt/novell/sentinel/config/auth.login -Djava.security.krb5.conf=/etc/opt/novell/sentinel/config/krb5.conf -Desecurity.execution.config.file=/etc/opt/novell/sentinel/config/execution.properties -Desecurity.router.config.file=/etc/opt/novell/sentinel/config/event-router.properties -Desecurity.jdbc.config.file=/etc/opt/novell/sentinel/config/postgresql_jdbc.properties -Djavax.net.ssl.trustStore=/etc/opt/novell/sentinel/config/.activemqkeystore.jks -Djavax.net.ssl.trustStorePassword=nw910oGE3PHtB5TAgKIo0A -Dsentinel.users.workflowlink.disable=false -Dactivemq.base=/var/opt/novell/sentinel/3rdparty/activemq -Djavax.net.ssl.keyStore=/etc/opt/novell/sentinel/config/.activemqkeystore.jks -Djavax.net.ssl.keyStorePassword=nw910oGE3PHtB5TAgKIo0A -Dactivemq.brokermaxmem=298 mb -Dlog4j.configurationFile=file:/etc/opt/novell/sentinel/config/activemqlog4j.properties -Dactivemq.classpath=/opt/novell/sentinel/3rdparty/activemq/conf -Djava.awt.headless=true -Xmx2988m -Dactivemq.brokermaxcon=2980 -Dsentinel.ldap.truststore.name=/etc/opt/novell/sentinel/config/.ldapkeystore.jks -Dsentinel.ldap.truststore.password=nw910oGE3PHtB5TAgKIo0A -Duser.country=US -Dreport.standalone.process.maxmem=2988 -Dreport.standalone.process.maxpermgenmem= -DEXCLUDED_CIPHERS=SSL_RSA_WITH_RC4_128_SHA,SSL_RSA_WITH_RC4_128_MD5,TLS_ECDHE_RSA_WITH_RC4_128_SHA,RSA_WITH_RC4_128_MD5,RSA_WITH_RC4_128_SHA,SSL_RSA_WITH_3DES_EDE_CBC_SHA,TLS_ECDHE_RSA_WITH_3DES_EDE_CBC_SHA,SSL_DHE_RSA_WITH_3DES_EDE_CBC_SHA -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -Xloggc:/var/opt/novell/sentinel/log/gc.log -XX:+PrintGC -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M -Djava.io.tmpdir=/var/opt/novell/sentinel/tmp -Dplatform=Linux -Ddebug=false -Dsystem.root= -javaagent:/opt/novell/sentinel/lib/notsoserial-1.0.jar -Dnotsoserial.blacklist=/etc/opt/novell/sentinel/config/deserialization-blacklist.conf -Dinternal.osp.framework.ext-context-dir=/etc/opt/novell/sentinel/osp -Dinternal.osp.framework.generic-properties-filename=/etc/opt/novell/sentinel/config/osp-configuration.properties -Xms2988m -Djava.library.path=/opt/novell/sentinel/lib:/opt/novell/sentinel/jdk/jre/lib/amd64/server:/opt/novell/sentinel/jdk/jre/lib/amd64:/opt/novell/sentinel/lib:/opt/novell/sentinel/jdk/jre/lib/amd64/server:/opt/novell/sentinel/jdk/jre/lib/amd64::/opt/novell/sentinel/lib/x86_64:/lib64:/usr/lib64:/opt/novell/sentinel/lib/x86_64:/lib64:/usr/lib64 -classpath /opt/novell/sentinel/lib/server-all.jar:/opt/novell/sentinel/lib/si-base-all.jar:/opt/novell/sentinel/lib/sm-bridge-all.jar:/opt/novell/sentinel/lib/jms-all.jar:/opt/novell/sentinel/lib/webserver-all.jar:/opt/novell/sentinel/jdk/lib/tools.jar -Dwrapper.key=q97WKDQFYwanZW6J -Dwrapper.port=32000 -Dwrapper.jvm.port.min=31000 -Dwrapper.jvm.port.max=31999 -Dwrapper.pid=12933 -Dwrapper.version=3.2.3 -Dwrapper.native_library=wrapper -Dwrapper.service=TRUE -Dwrapper.cpu.timeout=10 -Dwrapper.jvmid=1 esecurity.util.service.Service /etc/opt/novell/sentinel/config/server.xml /etc/opt/novell/sentinel/config/configuration.properties
    

    In my fresh 8.5 system (no attached collector managers) there is just an empty /var/opt/novell/sentinel/3rdparty/activemq/data/ directory.

Reply
  • Verified Answer

    +1   in reply to 

    ActiveMQ runs embedded in the main Sentinel process.

    sentinel:~ # lsof -i :61616
    COMMAND   PID   USER   FD   TYPE  DEVICE SIZE/OFF NODE NAME
    java    12948 novell  374u  IPv6 2293196      0t0  TCP *:61616 (LISTEN)
    
    sentinel:~ # ps ww -p 12948
      PID TTY      STAT   TIME COMMAND
    12948 ?        Sl    54:55 /opt/novell/sentinel/jdk/jre/bin/java -Dsrv_name=Server -server -Desecurity.home=/opt/novell/sentinel -Desecurity.data.home=/var/opt/novell/sentinel -Desecurity.config.home=/etc/opt/novell/sentinel -Desecurity.log.home=/var/opt/novell/sentinel -Desecurity.dataobjects.config.file=/xml/BaseMetaData.xml,/xml/WorkflowMetaData.xml,/xml/ActMetaData.xml -Desecurity.service.plugin=esecurity.util.service.ContainerService -Dcom.esecurity.configurationfile=/etc/opt/novell/sentinel/config/configuration.xml -Djava.util.logging.config.file=/etc/opt/novell/sentinel/config/server_log.prop -XX:+HeapDumpOnOutOfMemoryError -Xrs -Desecurity.sentinel.terminationTimeout=0 -Desecurity.sentinel.gracefulShutdownTimeout=30000 -XX:OnOutOfMemoryError=kill -9 %p -Desecurity.communication.service=Server2 -XX:MaxPermSize= -XX:+UseG1GC -XX:HeapDumpPath=/var/opt/novell/sentinel/log/Server.hprof -Duser.language=en -Dsentinel.securitymode.fips=false -Dfile.encoding=UTF8 -Desecurity.cache.directory=/var/opt/novell/sentinel/data/server.cache -Djava.security.auth.login.config=/etc/opt/novell/sentinel/config/auth.login -Djava.security.krb5.conf=/etc/opt/novell/sentinel/config/krb5.conf -Desecurity.execution.config.file=/etc/opt/novell/sentinel/config/execution.properties -Desecurity.router.config.file=/etc/opt/novell/sentinel/config/event-router.properties -Desecurity.jdbc.config.file=/etc/opt/novell/sentinel/config/postgresql_jdbc.properties -Djavax.net.ssl.trustStore=/etc/opt/novell/sentinel/config/.activemqkeystore.jks -Djavax.net.ssl.trustStorePassword=nw910oGE3PHtB5TAgKIo0A -Dsentinel.users.workflowlink.disable=false -Dactivemq.base=/var/opt/novell/sentinel/3rdparty/activemq -Djavax.net.ssl.keyStore=/etc/opt/novell/sentinel/config/.activemqkeystore.jks -Djavax.net.ssl.keyStorePassword=nw910oGE3PHtB5TAgKIo0A -Dactivemq.brokermaxmem=298 mb -Dlog4j.configurationFile=file:/etc/opt/novell/sentinel/config/activemqlog4j.properties -Dactivemq.classpath=/opt/novell/sentinel/3rdparty/activemq/conf -Djava.awt.headless=true -Xmx2988m -Dactivemq.brokermaxcon=2980 -Dsentinel.ldap.truststore.name=/etc/opt/novell/sentinel/config/.ldapkeystore.jks -Dsentinel.ldap.truststore.password=nw910oGE3PHtB5TAgKIo0A -Duser.country=US -Dreport.standalone.process.maxmem=2988 -Dreport.standalone.process.maxpermgenmem= -DEXCLUDED_CIPHERS=SSL_RSA_WITH_RC4_128_SHA,SSL_RSA_WITH_RC4_128_MD5,TLS_ECDHE_RSA_WITH_RC4_128_SHA,RSA_WITH_RC4_128_MD5,RSA_WITH_RC4_128_SHA,SSL_RSA_WITH_3DES_EDE_CBC_SHA,TLS_ECDHE_RSA_WITH_3DES_EDE_CBC_SHA,SSL_DHE_RSA_WITH_3DES_EDE_CBC_SHA -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -Xloggc:/var/opt/novell/sentinel/log/gc.log -XX:+PrintGC -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M -Djava.io.tmpdir=/var/opt/novell/sentinel/tmp -Dplatform=Linux -Ddebug=false -Dsystem.root= -javaagent:/opt/novell/sentinel/lib/notsoserial-1.0.jar -Dnotsoserial.blacklist=/etc/opt/novell/sentinel/config/deserialization-blacklist.conf -Dinternal.osp.framework.ext-context-dir=/etc/opt/novell/sentinel/osp -Dinternal.osp.framework.generic-properties-filename=/etc/opt/novell/sentinel/config/osp-configuration.properties -Xms2988m -Djava.library.path=/opt/novell/sentinel/lib:/opt/novell/sentinel/jdk/jre/lib/amd64/server:/opt/novell/sentinel/jdk/jre/lib/amd64:/opt/novell/sentinel/lib:/opt/novell/sentinel/jdk/jre/lib/amd64/server:/opt/novell/sentinel/jdk/jre/lib/amd64::/opt/novell/sentinel/lib/x86_64:/lib64:/usr/lib64:/opt/novell/sentinel/lib/x86_64:/lib64:/usr/lib64 -classpath /opt/novell/sentinel/lib/server-all.jar:/opt/novell/sentinel/lib/si-base-all.jar:/opt/novell/sentinel/lib/sm-bridge-all.jar:/opt/novell/sentinel/lib/jms-all.jar:/opt/novell/sentinel/lib/webserver-all.jar:/opt/novell/sentinel/jdk/lib/tools.jar -Dwrapper.key=q97WKDQFYwanZW6J -Dwrapper.port=32000 -Dwrapper.jvm.port.min=31000 -Dwrapper.jvm.port.max=31999 -Dwrapper.pid=12933 -Dwrapper.version=3.2.3 -Dwrapper.native_library=wrapper -Dwrapper.service=TRUE -Dwrapper.cpu.timeout=10 -Dwrapper.jvmid=1 esecurity.util.service.Service /etc/opt/novell/sentinel/config/server.xml /etc/opt/novell/sentinel/config/configuration.properties
    

    In my fresh 8.5 system (no attached collector managers) there is just an empty /var/opt/novell/sentinel/3rdparty/activemq/data/ directory.

Children
  • 0 in reply to   

    Thank you, klasen. I tried to get a post in yesterday that I got it running after I got the structure in place, but very nice to know that all you need is likely the empty structure. Do you have anything in /opt/novell/sentinel/3rdparty related to activemq? I didn't. I did have the /var/opt/novell/sentinel/3rdparty/activemq/data directory, though.

    It seems to me that I needed at least to have /opt/novell/sentinel/3rdparty/activemq/conf existing for it to start listening on port 61616. It does not seem to be described in any real detail that I have been able to find.