Unexpected issue with critical NNMi services reported as not found.

Jarosław Kęsy 1 month ago

Hello,

We experienced something which doesn't have any sense. Running NNMi 2022.05P3 I restarted yesterday NNMi services and after they came up we realized some of the crucial/important services are not started and they are reported to be NOT FOUND.

Does anyone know what could be the reason? The patch 3 for our 2022.05 version was installed like 3 weeks ago and the NNMi services were restarted many times since then.
We have no slightest idea why it happend just after they were restarted yesterday.

Service Health Agent
       +----------------------------------------------------------------------------------+-----------+ 
       | Service                                                                          | State     | 
       +----------------------------------------------------------------------------------+-----------+ 
       | com.hp.ov.nms:service=NmsModel                                                   | STARTED   | 
       | com.hp.ov.nms.apa:service=NmsApa                                                 | NOT_FOUND | 
       | com.hp.ov.nms.as.shared:service=Crypto                                           | STARTED   | 
       | com.hp.ov.nms.as.shared:service=NmsAuthService                                   | STARTED   | 
       | com.hp.ov.nms.as.shared:service=NmsCrlManager                                    | STARTED   | 
       | com.hp.ov.nms.as.shared:service=NmsTrustManager                                  | STARTED   | 
       | com.hp.ov.nms.comm.config:service=CommunicationModelService                      | STARTED   | 
       | com.hp.ov.nms.config:mbean=DiscoConfigurationSupport                             | STARTED   | 
       | com.hp.ov.nms.config:name=GeoExportService                                       | STARTED   | 
       | com.hp.ov.nms.custompoller:bean=CustomPollerUtilService                          | STARTED   | 
       | com.hp.ov.nms.custompoller:name=StateSyncNotifierMetrics                         | STARTED   | 
       | com.hp.ov.nms.custompoller:service=CPListener                                    | STARTED   | 
       | com.hp.ov.nms.custompoller:service=CustomPoller                                  | STARTED   | 
       | com.hp.ov.nms.custompoller:service=InstanceDiscoveryService                      | STARTED   | 
       | com.hp.ov.nms.custompoller:service=PolicySynchronizer                            | STARTED   | 
       | com.hp.ov.nms.custompoller.services.customexport:mbean=CustomPollerExportService | STARTED   | 
       | com.hp.ov.nms.disco:mbean=GeoDwnldMgrMBean                                       | STARTED   | 
       | com.hp.ov.nms.disco:service=NmsDisco                                             | STARTED   | 
       | com.hp.ov.nms.disco.geo:bean=GDCachingService                                    | STARTED   | 
       | com.hp.ov.nms.disco.geo:name=ServiceManager                                      | STARTED   | 
       | com.hp.ov.nms.disco.rediscover:bean=RediscoverService                            | STARTED   | 
       | com.hp.ov.nms.events:service=NmsEvents                                           | STARTED   | 
       | com.hp.ov.nms.events:service=NmsEventsConfiguration                              | STARTED   | 
       | com.hp.ov.nms.events:service=NmsTrapReceiver                                     | STARTED   | 
       | com.hp.ov.nms.geo.bridge:name=BridgeManager                                      | STARTED   | 
       | com.hp.ov.nms.geo.bridge:name=RequestCache                                       | STARTED   | 
       | com.hp.ov.nms.icmp:service=StagedIcmp                                            | STARTED   | 
       | com.hp.ov.nms.monitoring:bean=GlobalSettings                                     | STARTED   | 
       | com.hp.ov.nms.monitoring:mbean=ConfigExchangeRegistry                            | STARTED   | 
       | com.hp.ov.nms.monitoring:mbean=MonitoringSettingsListenersService                | STARTED   | 
       | com.hp.ov.nms.monitoring:mbean=NodeGroupAssignmentCacheService                   | STARTED   | 
       | com.hp.ov.nms.monitoring:mbean=NodeGroupSecurityCacheService                     | STARTED   | 
       | com.hp.ov.nms.monitoring:service=IslandSpotterService                            | STARTED   | 
       | com.hp.ov.nms.monitoring:service=MonitoringSettingsService                       | STARTED   | 
       | com.hp.ov.nms.performance.spi:bean=PerformanceSpiAdapterTopologyChangeService    | STARTED   | 
       | com.hp.ov.nms.performance.spi:name=RemoteMetricStats                             | STARTED   | 
       | com.hp.ov.nms.snmp:service=StagedSnmp                                            | STARTED   | 
       | com.hp.ov.nms.spi.common:service=NmsExtensionNotificationService                 | STARTED   | 
       | com.hp.ov.nms.statepoller:name=StateMapperGnmUpdateMetrics                       | NOT_FOUND | 
       | com.hp.ov.nms.statepoller:name=StateSyncNotifierMetrics                          | NOT_FOUND | 
       | com.hp.ov.nms.statepoller:service=NamedPoll                                      | NOT_FOUND | 
       | com.hp.ov.nms.statepoller:service=StatePoller                                    | NOT_FOUND | 
       | com.hp.ov.nms.topo:service=DatabaseMaintenance                                   | STARTED   | 
       | com.hp.ov.nms.topo:service=KeyManager                                            | STARTED   | 
       | com.hp.ov.nms.topo:service=NetworkApplication                                    | STARTED   | 
       | com.hp.ov.nms.topo:service=QueryService                                          | STARTED   | 
       | com.hp.ov.nms.topo:service=ScheduledOutage                                       | STARTED   | 
       | com.hp.ov.nms.topo.monitor:bean=TransactionMonitorService                        | STARTED   | 
       | com.hp.ov.nms.topo.services.customexport:mbean=CustomExportService               | STARTED   | 
       | com.hp.ov.nms.trapd:management=TrapConfigurationManagement                       | STARTED   | 
       | com.hp.ov.nms.trapd:service=NnmTrapService                                       | STARTED   | 
       | com.hp.ov.nms.trapd.pipeline:handler=ForwardToEvents                             | STARTED   | 
       | com.hp.ov.nms.trapd.pipeline:handler=TrapFilter                                  | STARTED   | 
       | com.hp.ov.nnm.security:service=TrustManager                                      | STARTED   | 
       +----------------------------------------------------------------------------------+-----------+

Best regards,

Jaroslaw Kesy

Tags:

NNMi

Top Replies

0 Misaq 1 month ago

There should be something in boot.log or nnm-trace.log. Do check the license.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 Jarosław Kęsy 1 month ago in reply to Misaq

HI,

In boot.log I noticed this entry:

2024-10-23 02:06:09.574 SEVERE [StatePoller] Error while starting StatePoller:

: java.lang.NoClassDefFoundError: com/hp/ov/nms/statepoller/collector/target/SNMPTargetResolverBase

2024-10-23 02:06:09.581 ERROR [AbstractKernelController] Error installing to Start: name=jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StatePollerService,service=EJB3 state=Create: com.hp.ov.nms.statepoller.common.StatePollerException: Exception on service: com.hp.ov.nms.statepoller.common.StatePollerException: com/hp/ov/nms/statepoller/collector/target/SNMPTargetResolverBase

Caused by: java.lang.NoClassDefFoundError: com/hp/ov/nms/statepoller/collector/target/SNMPTargetResolverBase

and in nnm.log file something like that:

2024-10-23 10:16:51.756 INFO [com.hp.ov.nms.statepoller.config.collection.CollectionManager] Loaded all possible monitored objects [77] into Custom Poller in 418 ms
2024-10-23 10:16:55.643 WARNING [com.hp.ov.nms.statepoller.statemapper.InputResultSetProcessor] An exception occurred while processing an input result set for StatePoller policy "alteonSessions" for measurement target "CPSnmpMeasurementTarget 10.189.180.61 (326420516454) timeout (5000) retries (2) version (3)". Internal Data:
Source: com.hp.ov.nms.statepoller.collector.Collector
: com.hp.ov.nms.statepoller.common.StatePollerException: Failed to create StatePoller policy handler for StatePoller policy "alteonSessions"
at com.hp.ov.nms.statepoller.statemapper.StatePollerPolicyHandlerManager.getStatePollerPolicyHandler(StatePollerPolicyHandlerManager.java:106)
at com.hp.ov.nms.statepoller.statemapper.InputResultSetProcessor.processResultSet(InputResultSetProcessor.java:154)
at com.hp.ov.nms.statepoller.bus.support.MeasurementConsumerSupport.handleEvent(MeasurementConsumerSupport.java:52)
at com.hp.ov.nms.statepoller.bus.support.MeasurementConsumerSupport.handleEvent(MeasurementConsumerSupport.java:30)
at com.hp.ov.nms.statepoller.util.eventqueue.EventQueueManager$Task.run(EventQueueManager.java:170)
at com.hp.ov.nms.statepoller.statemapper.processors.output.model.ModelOutputResultSetProcessor.getOutputAttributeJavaType(ModelOutputResultSetProcessor.java:511)
at com.hp.ov.nms.statepoller.statemapper.processors.output.model.ModelOutputResultSetProcessor.addOutputSpecification(ModelOutputResultSetProcessor.java:127)
at com.hp.ov.nms.custompoller.statepoller.statemapper.processors.output.model.CPModelOutputResultSetProcessor.addOutputSpecification(CPModelOutputResultSetProcessor.java:59)
at com.hp.ov.nms.statepoller.statemapper.StatePollerPolicyHandler.addPolledDataMapAndOutputResultSetProcessors(StatePollerPolicyHandler.java:228)
at com.hp.ov.nms.statepoller.statemapper.StatePollerPolicyHandler.<init>(StatePollerPolicyHandler.java:83)
at com.hp.ov.nms.statepoller.statemapper.StatePollerPolicyHandlerManager.getStatePollerPolicyHandler(StatePollerPolicyHandlerManager.java:95)
Deployment "com.hp.ov.nms.statepoller:service=StatePoller" is missing the following dependencies:
Dependency "<UNKNOWN com.hp.ov.nms.statepoller:service=StatePoller>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StatePollerService,service=EJB3' **")
Deployment "jboss-switchboard:appName=nms-statepoller,module=nms-statepoller-nnm,name=GeodiverseStateUpdateRequestMDB" is missing the following dependencies:
Dependency "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierBean,service=EJB3" (should be in state "Installed", but is actually in state "PreInstall")
Dependency "<UNKNOWN jboss.j2ee:ear=nms-apa.ear,jar=nms-apa-service-ejb.jar,name=NmsApa,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierBean,service=EJB3' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=ChassisFoundMDB,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=ChassisFoundMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=CommunicationConfigChangedMDB,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=CommunicationConfigChangedMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=DeviceExtensionNotificationListener,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=DeviceExtensionNotificationListener,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForAgentsAndAddressesMDB,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForAgentsAndAddressesMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateMetricsBean,service=EJB3' **")
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForAgentsAndAddressesMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForInterfacesMDB,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForInterfacesMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForInterfacesMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateMetricsBean,service=EJB3' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForOtherMDB,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForOtherMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForOtherMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateMetricsBean,service=EJB3' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForSensorsMDB,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForSensorsMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateMetricsBean,service=EJB3' **")
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForSensorsMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateMetricsBean,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateMetricsBean,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateRequestMDB,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateRequestMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierBean,service=EJB3' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GlobalConfigListener,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GlobalConfigListener,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=MissingEntityChangeMDB,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=MissingEntityChangeMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=MissingEntityChangeMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=MissingEntityChangeMetricsBean,service=EJB3' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=MissingEntityChangeMetricsBean,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=MissingEntityChangeMetricsBean,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=MonitoringConfigListenerMDB,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=MonitoringConfigListenerMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=NamedPollServerProxyMDB,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=NamedPollServerProxyMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=NamedPollService,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=NamedPollService,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=NodeLifecycleListener,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=NodeLifecycleListener,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=RemoteNamedPollServerMDB,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=RemoteNamedPollServerMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=NamedPollService,service=EJB3' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=SnmpActiveConfigurationChangedMDB,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=SnmpActiveConfigurationChangedMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=SpiExtensionNotificationListener,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=SpiExtensionNotificationListener,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=SpiStatusPollMDB,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=SpiStatusPollMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncDiscoveryCompleteMDB,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncDiscoveryCompleteMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierBean,service=EJB3' **")
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncDiscoveryCompleteMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierMetricsBean,service=EJB3' **")
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncDiscoveryCompleteMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierBean,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierBean,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierBean,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierMetricsBean,service=EJB3' **")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierBean,service=EJB3_endpoint" is missing the following dependencies:
Dependency "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierBean,service=EJB3" (should be in state "Installed", but is actually in state "PreInstall")
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierMetricsBean,service=EJB3" is missing the following dependencies:
Dependency "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierMetricsBean,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Dependency "<UNKNOWN jboss.j2ee:ear=perfspi-adaptor.ear,jar=perfspi-adaptor-ejb.jar,name=CentralMetricProcessorMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Dependency "<UNKNOWN jboss.j2ee:ear=perfspi-adaptor.ear,jar=perfspi-adaptor-ejb.jar,name=CentralTopoProcessorMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Dependency "<UNKNOWN jboss.j2ee:ear=perfspi-adaptor.ear,jar=perfspi-adaptor-ejb.jar,name=DynamicTopologyUpdateDumpMDB,service=EJB3>" (should be in state "Installed", but is actually in state "** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **")
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GlobalConfigListener,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=NodeLifecycleListener,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=SpiExtensionNotificationListener,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StatePollerService,service=EJB3" is in error due to the following reason(s): java.lang.ClassNotFoundException: com.hp.ov.nms.statepoller.collector.target.SNMPTargetResolverBase
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=MonitoringConfigListenerMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN com.hp.ov.nms.statepoller:service=StatePoller>" is in error due to the following reason(s): ** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StatePollerService,service=EJB3' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-apa.ear,jar=nms-apa-service-ejb.jar,name=NmsApa,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierBean,service=EJB3' **
Deployment "<UNKNOWN jboss.j2ee:ear=perfspi-adaptor.ear,jar=perfspi-adaptor-ejb.jar,name=CentralMetricProcessorMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=perfspi-adaptor.ear,jar=perfspi-adaptor-ejb.jar,name=DynamicTopologyUpdateDumpMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=perfspi-adaptor.ear,jar=perfspi-adaptor-ejb.jar,name=CentralTopoProcessorMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForAgentsAndAddressesMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateMetricsBean,service=EJB3' **, ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=SnmpActiveConfigurationChangedMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateRequestMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierBean,service=EJB3' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=NamedPollServerProxyMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=MissingEntityChangeMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=MissingEntityChangeMetricsBean,service=EJB3' **, ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=NamedPollService,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=DeviceExtensionNotificationListener,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierBean,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierMetricsBean,service=EJB3' **, ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierMetricsBean,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=ChassisFoundMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=CommunicationConfigChangedMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForOtherMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateMetricsBean,service=EJB3' **, ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=MissingEntityChangeMetricsBean,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=RemoteNamedPollServerMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=NamedPollService,service=EJB3' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForSensorsMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateMetricsBean,service=EJB3' **, ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateMetricsBean,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateForInterfacesMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=GeodiverseStateUpdateMetricsBean,service=EJB3' **, ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncDiscoveryCompleteMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierBean,service=EJB3' **, ** UNRESOLVED Demands 'jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=StateSyncNotifierMetricsBean,service=EJB3' **, ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
Deployment "<UNKNOWN jboss.j2ee:ear=nms-statepoller.ear,jar=nms-statepoller-nnm.jar,name=SpiStatusPollMDB,service=EJB3>" is in error due to the following reason(s): ** UNRESOLVED Demands 'com.hp.ov.nms.statepoller:service=StatePoller' **
2024-10-23 10:17:10.882 WARNING [com.hp.ov.nms.statepoller.statemapper.InputResultSetProcessor] An exception occurred while processing an input result set for StatePoller policy "ospfNeighborStates" for measurement target "CPSnmpMeasurementTarget 10.40.240.192 (156801693956) timeout (5000) retries (2) version (3)". Internal Data:
Source: com.hp.ov.nms.statepoller.collector.Collector
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 Misaq 1 month ago in reply to Jarosław Kęsy

can you post output of "ovstatus -v" I think some of the services may be missing from jboss.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 Jarosław Kęsy 1 month ago in reply to Misaq

root@frdv04332:~ # /opt/OV/bin/ovstatus -v
object manager name: OVsPMD
state: RUNNING
PID: 68518
last message: -
exit status: -

object manager name: ovjboss
state: RUNNING
PID: 68565
last message: Initialization complete.
exit status: -
additional info:
SERVICE STATUS
CommunicationModelService Service is started
CommunicationParametersStatsService Service is started
CustomPoller Service is started
IslandSpotterService Service is started
ManagedNodeLicenseManager Service is started
MonitoringSettingsService Service is started
NmsCustomCorrelation Service is started
NmsDisco Service is started
NmsEvents Service is started
NmsEventsConfiguration Service is started
NmsTrapReceiver Service is started
NnmTrapService Service is started
PerformanceSpiConsumptionManager Service is started
PipelineConfiguration Service is started
RbaManager Service is started
SpmdjbossStart Service is started
StagedIcmp Service is started
StagedSnmp Service is started
TrapConfigurationService Service is started
TrapPropertiesService Service is started
TrustManager Service is started

object manager name: nnmaction
state: RUNNING
PID: 69285
last message: Initialization complete.
exit status: -

object manager name: nnmtrapreceivermd
state: RUNNING
PID: 68520
last message: Initialization complete. Trap Receiver is running.

exit status: -

object manager name: nmsdbmgr
state: RUNNING
PID: 68519
last message: Database available.
exit status: -

object manager name: qajboss
state: RUNNING
PID: (never run)
last message: Initialization complete.
exit status: -

object manager name: qajboss
state: RUNNING
PID: (never run)
last message: Initialization complete.
exit status: -
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 Misaq 1 month ago in reply to Jarosław Kęsy
I would suggest opening a support case as they will have more insight into this and may need to web-ex .

Following are some suggestions to look into:

check other log files for errors at same time interval(std_err etc. and some in public folder under log directory). db log may also contain some information.

Also check for system resources (disk space, memory, port conflict ).

If you have some customization that may need to be addressed (policy, custom poller) I had issues in one case after patching.

please also post your system OS and version. I have 2205 P2 on RHEL 9.4 so may be a bit different.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 Jarosław Kęsy 1 month ago in reply to Misaq

Hi,

Long story short:
I recovered the whole NNMi server from backup taken last week before I applied the newest Device Drivers Pack. I identified what jar files were provided with this DDP. I replaced this one /opt/OV/NNM/server/lib/nms-device-common.jar with the version provided with DDP from July.
And started NNMi services again. And to my surprise all services are running now fine. WTF?!

Maybe this file /opt/OV/NNM/server/lib/nms-device-common.jar is not fully compatibile with the OpenJDK we are using (OpenJDK Runtime Environment (build 1.8.0_412-b08)).

My workaround is "nasty" and I hope it will not lead to any unusual behavior of NNMi. But should be investigated by OpenText imho.

Thank you for your suggestions.
Cancel
Vote Up +1 Vote Down

Sign in to reply

Verify Answer

Cancel
0 asoloperto 1 month ago in reply to Jarosław Kęsy

Hello Jaroslaw,

did you have any feedback from the OT support?

It seems, that a customer has the same problem after installing the DDP October 2024 on his NNM 2022.05 (no patch) system.

Best regards

Allessandro Soloperto
ITC GmbH - Senior Consultant
If this answered your question, please mark it as "Suggest as Answer" or "Verify as Answer".
If you found this response useful, please give it a "Like".
Cancel
Vote Up +1 Vote Down

Sign in to reply

Verify Answer

Cancel
0 Misaq 1 month ago in reply to asoloperto

can confirm I can reproduce the issue with NNMi 2022.05 and OCT 2024 device drivers.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 asoloperto 1 month ago in reply to Misaq

Hello Misaq,

so the problem is reproducable and OT should be able to find the problem.

Thanks and best regards

Allessandro Soloperto
ITC GmbH - Senior Consultant
If this answered your question, please mark it as "Suggest as Answer" or "Verify as Answer".
If you found this response useful, please give it a "Like".
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 Jarosław Kęsy 1 month ago in reply to asoloperto

Hi Allesandro,

I cannot create a direct support case to OT support but our external consultant did that and is waiting for a feedback.

Best regards.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel

Menu

Network Operations Management Discussions

Verified Answers

Unexpected issue with critical NNMi services reported as not found.

Tags:

Top Replies

Resources