Environment

Operations Bridge Manager (OBM) 2021.11 (11.20) IP1

Situation

If a OBM server is removed from a HA setup with opr-management-server-cli.sh, certain DB values are not cleaned up. The value of sp_value_clob for sp_name = 'hardening.config' in setting_parameters table did still contain an entry in the <hostsTable> section that refered to the removed server.

This caused the following error in the hardening workflow that prevented OBM from starting up after a reconfiguration with the configuration wizard:

2023-08-10 11:03:13,894 [nanny Manager:Initialize Task] (HardeningMainWorkflow.java:154) ERROR - Failed to finish HardeningMainWorkflow transaction
2023-08-10 11:03:13,895 [nanny Manager:Initialize Task] (Hardening.java:70) ERROR - Exception while executing hardening main workflow.
com.hp.bsm.platform.security.hardening.workflow.WorkflowException: Failed to execute workflow
at com.hp.bsm.platform.security.hardening.workflow.TransactionWorkflow.execute(TransactionWorkflow.java:17)
at com.hp.bsm.platform.security.hardening.Hardening.execute(Hardening.java:64)
at com.hp.bsm.platform.security.hardening.HardeningPreInitializer.preInitialize(HardeningPreInitializer.java:39)
at com.mercury.infra.nanny.manager.Main$InitializeTask.preInitialize(Main.java:86)
at com.mercury.infra.nanny.manager.Main$InitializeTask.run(Main.java:157)
at java.lang.Thread.run(Thread.java:748)
aused by: java.lang.IllegalStateException: Tried to get a success return value from a Failure response
at com.mercury.topaz.tmc.response.TMCTypedResponse.getObject(TMCTypedResponse.java:62)
at com.mercury.topaz.tmc.response.TMCStringResponse.getString(TMCStringResponse.java:46)
at com.hp.bsm.platform.security.hardening.HardeningUtils.getHostNameForHost(HardeningUtils.java:972)
at com.hp.bsm.platform.security.hardening.workflow.generation.GenerateHostCertificates.execute(GenerateHostCertificates.java:61)
at com.hp.bsm.platform.security.hardening.workflow.Workflow.execute(Workflow.java:22)
at com.hp.bsm.platform.security.hardening.workflow.TransactionWorkflow.execute(TransactionWorkflow.java:12)
... 5 more
2023-08-10 11:03:13,902 [nanny Manager:Initialize Task] (HardeningConfigurationLock.java:99) INFO  - Releasing hardening configuration lock.

Read the complete knowledge doc for resolution.