We Keep Coding

deployment ".war" was rolled back with no failure message

I'm trying do deploy a java spring project on ec2 but the deployment fails.
On Jenkins I get this message:
"Failed to connect to the host via ssh: Shared connection to *ip* closed.", "unreachable": true
checking the server logs, I found this error:
ERROR [org.jboss.as.server] (management-handler-thread - 2) WFLYSRV0022:
Deploy of deployment "*.war" was rolled back with no failure message

WildFly 15: Failed to process phase STRUCTURE of deployment

I have read other questions on the same topic, but those are not my case. I try to deploy an application on WildFly and have this error:
2019-11-14 11:06:58,562 INFO [org.jboss.as.repository] (External Management Request Threads -- 1) WFLYDR0001: Content added at location D:\work\wildfly-15.0.1.Final\standalone\data\content\6d\d62dd454af846488c4814676d305f116c43aa2\content
2019-11-14 11:07:05,707 INFO [org.jboss.as.server.deployment] (MSC service thread 1-2) WFLYSRV0027: Starting deployment of "myApp.ear" (runtime-name: "myApp.ear")
2019-11-14 11:07:06,969 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-7) MSC000001: Failed to start service jboss.deployment.unit."myApp.ear".STRUCTURE: org.jboss.msc.service.StartException in service jboss.deployment.unit."myApp.ear".STRUCTURE: WFLYSRV0153: Failed to process phase STRUCTURE of deployment "myApp.ear"
at org.jboss.as.server.deployment.DeploymentUnitPhaseService.start(DeploymentUnitPhaseService.java:151)
at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1738)
at org.jboss.msc.service.ServiceControllerImpl$StartTask.execute(ServiceControllerImpl.java:1700)
at org.jboss.msc.service.ServiceControllerImpl$ControllerTask.run(ServiceControllerImpl.java:1558)
at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1378)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.jboss.as.server.deployment.DeploymentUnitProcessingException: WFLYEE0031: Unable to process modules in application.xml for EAR ["/D:/work/content/myApp.ear"], module file server-${project.version}.war not found
at org.jboss.as.ee.structure.EarStructureProcessor.deploy(EarStructureProcessor.java:187)
at org.jboss.as.server.deployment.DeploymentUnitPhaseService.start(DeploymentUnitPhaseService.java:144)
... 8 more
Builded myApp.ear contains all needed wars, BUT /D:/work/content/myApp.ear is wrong path. As far as I could understand right path must be something like this: path_to_local_WF_instance/standalone/data/content/... Other applications deploy on this local WF without any problem. How can I set the right path and what is this problem in general? Thanks.

Deployment scanner is looking for a file named "server-${project.version}.war" in your EAR. Propably the version property is not correct resolved in the application.xml file.

Wildfly suspending intermittently my web application

Wildfly are suspending intermittently my java web application. This occur often one time in the week.
I'm running my service with the following configuration:
Ubuntu 16 8GB
Intel(R) Xeon(R) CPU E5-2640 v3 # 2.60GHz
Web Application:
Wildfly 14
Java 11
JavaEE 8
Postgresql
2019-08-08 07:35:14,619 ERROR [org.jboss.as.server.deployment.scanner] (DeploymentScanner-threads - 1) WFLYDS0012: Scan of /opt/wildfly-14.0.1.Final/standalone/deployments threw Exception: java.lang.RuntimeException: WFLYDS0032: Failed to list files in directory /opt/wildfly-14.0.1.Final/standalone/deployments. Check that the contents of the directory are readable.
at org.jboss.as.deployment-scanner#6.0.2.Final//org.jboss.as.server.deployment.scanner.FileSystemDeploymentService.listDirectoryChildren(FileSystemDeploymentService.java:1365)
at org.jboss.as.deployment-scanner#6.0.2.Final//org.jboss.as.server.deployment.scanner.FileSystemDeploymentService.scanDirectory(FileSystemDeploymentService.java:846)
at org.jboss.as.deployment-scanner#6.0.2.Final//org.jboss.as.server.deployment.scanner.FileSystemDeploymentService.scan(FileSystemDeploymentService.java:598)
at org.jboss.as.deployment-scanner#6.0.2.Final//org.jboss.as.server.deployment.scanner.FileSystemDeploymentService.scan(FileSystemDeploymentService.java:493)
at org.jboss.as.deployment-scanner#6.0.2.Final//org.jboss.as.server.deployment.scanner.FileSystemDeploymentService$DeploymentScanRunnable.run(FileSystemDeploymentService.java:255)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
at org.jboss.threads#2.3.2.Final//org.jboss.threads.JBossThread.run(JBossThread.java:485)
Caused by: java.nio.file.FileSystemException: /opt/wildfly-14.0.1.Final/standalone/deployments: Too many open files
at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:100)
at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)
at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116)
at java.base/sun.nio.fs.UnixFileSystemProvider.newDirectoryStream(UnixFileSystemProvider.java:428)
at java.base/java.nio.file.Files.newDirectoryStream(Files.java:603)
at org.jboss.as.deployment-scanner#6.0.2.Final//org.jboss.as.server.deployment.scanner.FileSystemDeploymentService.listDirectoryChildren(FileSystemDeploymentService.java:1358)
... 11 more
2019-08-08 07:55:11,261 INFO [org.jboss.as.server] (Thread-1) WFLYSRV0236: Suspending server with no timeout.
2019-08-08 07:55:11,272 INFO [org.jboss.as.ejb3] (Thread-1) WFLYEJB0493: EJB subsystem suspension complete
2019-08-08 07:55:11,285 INFO [org.jboss.as.server] (Thread-1) WFLYSRV0220: Server shutdown has been requested via an OS signal
2019-08-08 07:55:11,324 INFO [org.jboss.as.mail.extension] (MSC service thread 1-8) WFLYMAIL0002: Unbound mail session [java:jboss/mail/Default]
2019-08-08 07:55:11,327 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 72) WFLYUT0022: Unregistered web context: '/service' from server 'default-server'

Looks like some process may be your web server process is keeping files open and it is reaching beyond ulimit.
To find root cause, you can simply use lsof linux command to see all the open files and their respective process ids.
1) if you find you could control this count of open files, then it's good.
2) if it's unavoidable, then try increasing ulimit

Access external libraries (JARs) from another JAR in JBOSS/Wildfly

I've written a custom jar which should be added to a Keycloak's deployment folder (Keycloak runs on a JBOSS/Wildfly server). The problem I'm facing is that after deployment, no external jar seems to be reachable. This looks like is mnore related to JBOSS/Wildfly class/module loading mechanism, than Keycloak itself.
I'm receiving following error from the console when the code hits an external class:
11:21:56,095 WARN [org.jboss.modules.define] (default task-3) Failed to define class org.springframework.ws.client.core.support.WebServiceGatewaySupport in Module
"deployment.spring-ws-core-3.0.7.RELEASE.jar" from Service Module Loader: java.lang.NoClassDefFoundError: Failed to link org/springframework/ws/client/core/support/WebServiceGatewaySupport
(Module "deployment.spring-ws-core-3.0.7.RELEASE.jar" from Service Module Loader): org/springframework/beans/factory/InitializingBean at java.lang.ClassLoader.defineClass1(Native Method)
1 - I've followed the approach described here : Deploy JAR as a module on JBoss 7.1.1
2 - the libraries load correctly as seen on the console:
11:19:21,883 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 54) WFLYUT0021: Registered web context: '/auth' for server 'default-server'
11:19:22,021 INFO [org.jboss.as.server] (ServerService Thread Pool -- 32) WFLYSRV0010: Deployed "spring-xml-3.0.7.RELEASE.jar" (runtime-name : "spring-xml-3.0.7.RELEASE.jar")
11:19:22,021 INFO [org.jboss.as.server] (ServerService Thread Pool -- 42) WFLYSRV0010: Deployed "keycloak-server.war" (runtime-name : "keycloak-server.war")
11:19:22,021 INFO [org.jboss.as.server] (ServerService Thread Pool -- 32) WFLYSRV0010: Deployed "spring-ws-core-3.0.7.RELEASE.jar" (runtime-name : "spring-ws-core-3.0.7.RELEASE.jar")
11:19:22,022 INFO [org.jboss.as.server] (ServerService Thread Pool -- 32) WFLYSRV0010: Deployed "maven-jaxb23-plugin-0.14.0.jar" (runtime-name : "maven-jaxb23-plugin-0.14.0.jar")
11:19:22,023 INFO [org.jboss.as.server] (ServerService Thread Pool -- 32) WFLYSRV0010: Deployed "maven-jaxb2-plugin-core-0.14.0.jar" (runtime-name : "maven-jaxb2-plugin-core-0.14.0.jar")
11:19:22,023 INFO [org.jboss.as.server] (ServerService Thread Pool -- 32) WFLYSRV0010: Deployed "maven-jaxb2-plugin-0.14.0.jar" (runtime-name : "maven-jaxb2-plugin-0.14.0.jar")
11:19:22,023 INFO [org.jboss.as.server] (ServerService Thread Pool -- 32) WFLYSRV0010: Deployed "customIsaacAuthenticatorKeycloakSPI-1.0-SNAPSHOT.jar" (runtime-name : "customIsaacAuthenticatorKeycloakSPI-1.0-SNAPSHOT.jar")
3- My MANIFEST.MF looks like this (and is also correctly loading after checking all dependencies):
Manifest-Version: 1.0
Archiver-Version: Plexus Archiver
Created-By: Apache Maven
Built-By: [ - me :) -]
Build-Jdk: 1.8.0_131
Dependencies: deployment.spring-ws-core-3.0.7.RELEASE.jar, deployment.
spring-xml-3.0.7.RELEASE.jar, deployment.maven-jaxb2-plugin-0.14.0.ja
r, deployment.maven-jaxb2-plugin-core-0.14.0.jar, deployment.maven-ja
xb23-plugin-0.14.0.jar
Nevertheless the problem recongnizing an external class from JBOSS/WILDFLY (where Keycloak is deployed) remains. Can somebody please help me pointing out a possible approach as to how can I make the external library jar be visible from my SPI jar?
Thanks is advance!

Issues deploying a simple WAR application in JBOSS 6 EAP that worked in JBOSS AS 5

I have a MAVEN war file which works just fine in my old JBOSS 5.1 AS Environment. However, when I try adding the war into the JBOSSEAP/standalone/deployments directory (via the management console UI or directly), I get the following error which I'm unable to make sense of:
15:45:07,693 ERROR [org.jboss.as.controller.management-operation]
(HttpManagementService-threads - 1) JBAS014612: Operation ("add")
failed - address: ([{"deployment" => "clinicalTrials.war"}]) - failure
description: {"JBAS014771: Services with missing/unavailable
dependencies" => ["jboss.deployment.unit.\"clinicalTrials.war\".PARSE
is missing
[jboss.deployment.subunit.\"clinicalTrials.war\".WEB-INF/classes.STRUCTURE]"]}
15:45:07,694 ERROR [org.jboss.as.server] (HttpManagementService-threads - 1) JBAS015870: Deploy of deployment
"clinicalTrials.war" was rolled back with the following failure
message: {"JBAS014771: Services with missing/unavailable dependencies"
=> ["jboss.deployment.unit.\"clinicalTrials.war\".PARSE is missing [jboss.deployment.subunit.\"clinicalTrials.war\".WEB-INF/classes.STRUCTURE]"]}
15:45:07,698 INFO [org.jboss.as.server.deployment] (MSC service thread 1-8) JBAS015974: Stopped subdeployment (runtime-name:
WEB-INF/classes) in 2ms
15:45:07,735 INFO [org.jboss.as.server.deployment] (MSC service thread 1-8) JBAS015877: Stopped deployment clinicalTrials.war
(runtime-name: clinicalTrials.war) in 40ms
15:45:07,735 INFO [org.jboss.as.controller] (HttpManagementService-threads - 1) JBAS014774: Service status report
JBAS014775: New missing/unsatisfied dependencies:
service jboss.deployment.subunit."clinicalTrials.war".WEB-INF/classes
(missing) dependents: [service
jboss.deployment.unit."clinicalTrials.war".PARSE]
service jboss.deployment.subunit."clinicalTrials.war".WEB-INF/classes.STRUCTURE
(missing) dependents: [service
jboss.deployment.unit."clinicalTrials.war".PARSE]
I have run a jar tvf clinicalTrials.war to ensure the war deployment contains all of the classes and again, this is working in my JBOSS 5 AS Environment when I plop it in the server/default/deploy directory so I'm not quite sure what I'm missing. I have set the log level to DEBUG but it doesn't seem to help.

Depending on the jar files that are included in the war files especially those related to Hibernate, JSF and XML parser, need to play around with WEB-INF/jboss-deployment-structure.xml to make sure the correct version are loaded. Some of the jars under the modules are automatically loaded base on the presences of certain files in the war (see JBoss documentation on Module). This could suppress the local version from loading under the local lib causing the error.