Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

port option is ignored when using coordinator #131

Open
karunakant opened this issue Dec 13, 2024 · 0 comments
Open

port option is ignored when using coordinator #131

karunakant opened this issue Dec 13, 2024 · 0 comments

Comments

@karunakant
Copy link

when running this command

jlama cluster-coordinator tjake/Llama-3.2-1B-Instruct-JQ4 --auto-download --grpc-port=8443 --include-worker=false --port=7080 --worker-count=2 --threads=2

the port keeps running on 8080, was expecting it to run on 7080

. ____ _ __ _ _
/\ / ' __ _ () __ __ _ \ \ \
( ( )_
_ | '_ | '| | ' / ` | \ \ \
\/ )| |)| | | | | || (| | ) ) ) )
' |
| .__|| ||| |_, | / / / /
=========|
|==============|/=////

:: Spring Boot :: (v3.3.2)

2024-12-13T22:54:07.400+05:30 INFO 136570 --- [ main] com.github.tjake.jlama.cli.JlamaCli : Starting JlamaCli using Java 20.0.2 with PID 136570 (/home/dev/.m2/repository/com/github/tjake/jlama-cli/0.8.2/jlama-cli-0.8.2.jar started by dev in /home/dev)
2024-12-13T22:54:07.403+05:30 INFO 136570 --- [ main] com.github.tjake.jlama.cli.JlamaCli : No active profile set, falling back to 1 default profile: "default"
2024-12-13T22:54:08.180+05:30 WARN 136570 --- [ main] io.undertow.websockets.jsr : UT026010: Buffer pool was not set on WebSocketDeploymentInfo, the default pool will be used
2024-12-13T22:54:08.192+05:30 INFO 136570 --- [ main] io.undertow.servlet : Initializing Spring embedded WebApplicationContext
2024-12-13T22:54:08.194+05:30 INFO 136570 --- [ main] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 759 ms
2024-12-13T22:54:08.296+05:30 INFO 136570 --- [ main] io.undertow : starting server: Undertow - 2.3.13.Final
2024-12-13T22:54:08.301+05:30 INFO 136570 --- [ main] org.xnio : XNIO version 3.8.8.Final
2024-12-13T22:54:08.306+05:30 INFO 136570 --- [ main] org.xnio.nio : XNIO NIO Implementation Version 3.8.8.Final
2024-12-13T22:54:08.437+05:30 INFO 136570 --- [ main] org.jboss.threads : JBoss Threads version 3.5.0.Final
2024-12-13T22:54:08.475+05:30 INFO 136570 --- [ main] o.s.b.w.e.undertow.UndertowWebServer : Undertow started on port 8080 (http) with context path '/'
2024-12-13T22:54:08.523+05:30 INFO 136570 --- [ main] o.s.b.a.w.s.WelcomePageHandlerMapping : Adding welcome page: class path resource [static/index.html]
2024-12-13T22:54:08.742+05:30 INFO 136570 --- [ XNIO-1 task-2] io.undertow.servlet : Initializing Spring DispatcherServlet 'dispatcherServlet'
2024-12-13T22:54:08.743+05:30 INFO 136570 --- [ XNIO-1 task-2] o.s.web.servlet.DispatcherServlet : Initializing Servlet 'dispatcherServlet'
2024-12-13T22:54:08.940+05:30 INFO 136570 --- [ main] com.github.tjake.jlama.cli.JlamaCli : Started JlamaCli in 1.855 seconds (process running for 3.621)
2024-12-13T22:54:08.988+05:30 INFO 136570 --- [ XNIO-1 task-2] o.s.web.servlet.DispatcherServlet : Completed initialization in 229 ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant