웹페이지 첫 접속
INFO [2024-07-29 21:33:10,314] ({qtp730923082-36} NoAuthenticationService.java[<init>]:38) - NoAuthenticationService is initialized
WARN [2024-07-29 21:33:10,321] ({qtp730923082-36} SecurityRestApi.java[ticket]:82) - {"status":"OK","message":"","body":{"principal":"anonymous","ticket":"anonymous","roles":"[]"}}
WARN [2024-07-29 21:33:10,396] ({qtp730923082-28} ClusterRestApi.java[<init>]:66) - Cluster mode is disabled, ClusterRestApi won't work
INFO [2024-07-29 21:33:10,421] ({qtp730923082-37} NotebookServer.java[onOpen]:261) - Open connection to /127.0.0.1:63998 with Session: WebSocketSession[websocket=JsrAnnotatedEventDriver[websocket=org.apache.zeppelin.socket.NotebookServer@28b576a9],behavior=SERVER,connection=WebSocketServerConnection@7279bb48::SocketChannelEndPoint@21fc8a5b{l=/127.0.0.1:8080,r=/127.0.0.1:63998,OPEN,fill=-,flush=-,to=6/300000}{io=0/0,kio=0,kro=1}->WebSocketServerConnection@7279bb48[s=ConnectionState@56ea5ee6[OPENING],f=Flusher@58a3a996[IDLE][queueSize=0,aggregateSize=-1,terminated=null],g=Generator[SERVER,validating,+rsv1],p=Parser@4f54d4ce[ExtensionStack,s=START,c=0,len=0,f=null]],remote=WebSocketRemoteEndpoint@67e12913[batching=true],incoming=JsrAnnotatedEventDriver[websocket=org.apache.zeppelin.socket.NotebookServer@28b576a9],outgoing=ExtensionStack[queueSize=0,extensions=[permessage-deflate],incoming=org.eclipse.jetty.websocket.common.extensions.compress.PerMessageDeflateExtension,outgoing=org.eclipse.jetty.websocket.common.extensions.compress.PerMessageDeflateExtension]], config: [Origin, javax.websocket.endpoint.localAddress, javax.websocket.upgrade.locales, javax.websocket.endpoint.remoteAddress, X-Watcher-Key]
배시 노트북 들어가기
INFO [2024-07-29 21:34:24,430] ({qtp730923082-27} Helium.java[loadConf]:144) - Add helium local registry .//helium
WARN [2024-07-29 21:34:24,430] ({qtp730923082-27} Helium.java[loadConf]:152) - .//.//conf/helium.json does not exists
INFO [2024-07-29 21:34:24,496] ({qtp730923082-27} InterpreterSetting.java[getOrCreateInterpreterGroup]:461) - Create InterpreterGroup with groupId: sh-shared_process for ExecutionContext{user='anonymous', noteId='2K6XUEPFY', interpreterGroupId='null', defaultInterpreterGroup='sh', inIsolatedMode=false, startTime=}
INFO [2024-07-29 21:34:24,500] ({qtp730923082-27} InterpreterSetting.java[createInterpreters]:849) - Interpreter org.apache.zeppelin.shell.ShellInterpreter created for user: anonymous, sessionId: shared_session
INFO [2024-07-29 21:34:24,501] ({qtp730923082-27} InterpreterSetting.java[createInterpreters]:849) - Interpreter org.apache.zeppelin.shell.TerminalInterpreter created for user: anonymous, sessionId: shared_session
INFO [2024-07-29 21:34:24,502] ({qtp730923082-27} ManagedInterpreterGroup.java[getOrCreateSession]:182) - Create Session: shared_session in InterpreterGroup: sh-shared_process for user: anonymous
WARN [2024-07-29 21:34:24,566] ({qtp730923082-27} GitNotebookRepo.java[revisionHistory]:224) - No Head found for bash-example_2K6XUEPFY.zpln, No HEAD exists and no explicit starting revision was specified
실행부터 완료까지
INFO [2024-07-29 22:40:58,248] ({qtp730923082-72} NotebookService.java[runParagraph]:427) - Start to run paragraph: paragraph_1722255061923_1106037841 of note: 2K6XUEPFY
INFO [2024-07-29 22:41:52,730] ({qtp730923082-72} VFSNotebookRepo.java[save]:145) - Saving note 2K6XUEPFY to bash-example_2K6XUEPFY.zpln
INFO [2024-07-29 22:41:52,745] ({qtp730923082-72} SchedulerFactory.java[<init>]:55) - Scheduler Thread Pool Size: 100
INFO [2024-07-29 22:41:56,361] ({FIFO-RemoteInterpreter-sh-shared_process-shared_session-1} AbstractScheduler.java[runJob]:130) - Job paragraph_1722255061923_1106037841 started by scheduler RemoteInterpreter-sh-shared_process-shared_session
INFO [2024-07-29 22:41:56,362] ({FIFO-RemoteInterpreter-sh-shared_process-shared_session-1} Paragraph.java[jobRun]:404) - Run paragraph [paragraph_id: paragraph_1722255061923_1106037841, interpreter: org.apache.zeppelin.shell.ShellInterpreter, note_id: 2K6XUEPFY, user: anonymous]
INFO [2024-07-29 22:41:56,362] ({FIFO-RemoteInterpreter-sh-shared_process-shared_session-1} ManagedInterpreterGroup.java[getOrCreateInterpreterProcess]:68) - Create InterpreterProcess for InterpreterGroup: sh-shared_process
INFO [2024-07-29 22:41:56,363] ({FIFO-RemoteInterpreter-sh-shared_process-shared_session-1} PluginManager.java[loadInterpreterLauncher]:110) - Loading Interpreter Launcher Plugin: org.apache.zeppelin.interpreter.launcher.StandardInterpreterLauncher
INFO [2024-07-29 22:41:56,364] ({FIFO-RemoteInterpreter-sh-shared_process-shared_session-1} StandardInterpreterLauncher.java[launchDirectly]:50) - Launching new interpreter process of sh
INFO [2024-07-29 22:41:56,439] ({FIFO-RemoteInterpreter-sh-shared_process-shared_session-1} ProcessLauncher.java[transition]:109) - Process state is transitioned to LAUNCHED
INFO [2024-07-29 22:41:56,439] ({FIFO-RemoteInterpreter-sh-shared_process-shared_session-1} ProcessLauncher.java[launch]:96) - Process is launched: [.//bin/interpreter.sh, -d, .//interpreter/sh, -c, 192.168.0.8, -p, 64093, -r, :, -i, sh-shared_process, -l, .//local-repo/sh, -g, sh]
INFO [2024-07-29 22:41:57,070] ({Exec Stream Pumper} ProcessLauncher.java[processLine]:193) - [INFO] Interpreter launch command: /Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/bin/java -Dfile.encoding=UTF-8 -Dlog4j.configuration=file:///Users/pgt0409/Desktop/git/zeppelin/conf/log4j.properties -Dlog4j.configurationFile=file:///Users/pgt0409/Desktop/git/zeppelin/conf/log4j2.properties -Dzeppelin.log.file=/Users/pgt0409/Desktop/git/zeppelin/logs/zeppelin-interpreter-sh-shared_process-pgt0409-parkgyeongtae-4.local.log -Xmx1024m -cp '':.//local-repo/sh/*:.//interpreter/sh/*:/Users/pgt0409/Desktop/git/zeppelin/zeppelin-interpreter-shaded/target/*:/Users/pgt0409/Desktop/git/zeppelin/zeppelin-zengine/target/test-classes/*:::/Users/pgt0409/Desktop/git/zeppelin/interpreter/zeppelin-interpreter-shaded-0.12.0-SNAPSHOT.jar:/Users/pgt0409/Desktop/git/zeppelin/zeppelin-interpreter/target/classes:/Users/pgt0409/Desktop/git/zeppelin/zeppelin-zengine/target/test-classes org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer 192.168.0.8 64093 sh-shared_process :
INFO [2024-07-29 22:41:58,516] ({pool-3-thread-2} RemoteInterpreterEventServer.java[registerInterpreterProcess]:183) - Register interpreter process: 192.168.0.8:64108, interpreterGroup: sh-shared_process
INFO [2024-07-29 22:41:58,516] ({pool-3-thread-2} ProcessLauncher.java[transition]:109) - Process state is transitioned to RUNNING
INFO [2024-07-29 22:41:58,612] ({FIFO-RemoteInterpreter-sh-shared_process-shared_session-1} RemoteInterpreter.java[lambda$internal_create$1]:162) - Create RemoteInterpreter org.apache.zeppelin.shell.ShellInterpreter
INFO [2024-07-29 22:41:58,680] ({FIFO-RemoteInterpreter-sh-shared_process-shared_session-1} RemoteInterpreter.java[lambda$internal_create$1]:162) - Create RemoteInterpreter org.apache.zeppelin.shell.TerminalInterpreter
INFO [2024-07-29 22:41:58,695] ({FIFO-RemoteInterpreter-sh-shared_process-shared_session-1} RemoteInterpreter.java[lambda$open$0]:136) - Open RemoteInterpreter org.apache.zeppelin.shell.ShellInterpreter
INFO [2024-07-29 22:41:58,695] ({FIFO-RemoteInterpreter-sh-shared_process-shared_session-1} RemoteInterpreter.java[pushAngularObjectRegistryToRemote]:392) - Push local angular object registry from ZeppelinServer to remote interpreter group sh-shared_process
INFO [2024-07-29 22:41:58,829] ({JobStatusPoller-paragraph_1722255061923_1106037841} NotebookServer.java[onStatusChange]:2086) - Job paragraph_1722255061923_1106037841 starts to RUNNING
INFO [2024-07-29 22:41:58,830] ({JobStatusPoller-paragraph_1722255061923_1106037841} VFSNotebookRepo.java[save]:145) - Saving note 2K6XUEPFY to bash-example_2K6XUEPFY.zpln
INFO [2024-07-29 22:41:58,861] ({FIFO-RemoteInterpreter-sh-shared_process-shared_session-1} NotebookServer.java[onStatusChange]:2081) - Job paragraph_1722255061923_1106037841 is finished successfully, status: FINISHED
INFO [2024-07-29 22:41:58,861] ({FIFO-RemoteInterpreter-sh-shared_process-shared_session-1} VFSNotebookRepo.java[save]:145) - Saving note 2K6XUEPFY to bash-example_2K6XUEPFY.zpln
INFO [2024-07-29 22:41:58,865] ({FIFO-RemoteInterpreter-sh-shared_process-shared_session-1} AbstractScheduler.java[runJob]:150) - Job paragraph_1722255061923_1106037841 finished by scheduler RemoteInterpreter-sh-shared_process-shared_session with status FINISHED
진입
zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookServer.java
case RUN_PARAGRAPH:
runParagraph(conn, context, receivedMessage);
break;
zeppelin-server/src/main/java/org/apache/zeppelin/service/NotebookService.java
public boolean runParagraph(Note note,
String paragraphId,
String title,
String text,
Map<String, Object> params,
Map<String, Object> config,
String sessionId,
boolean failIfDisabled,
boolean blocking,
ServiceContext context,
ServiceCallback<Paragraph> callback) throws IOException {
제플린 프로세스
501 51457 ttys000 0:00.00 grep --color=auto --exclude-dir=.bzr --exclude-dir=CVS --exclude-dir=.git --exclude-dir=.hg --exclude-dir=.svn --exclude-dir=.idea --exclude-dir=.tox zeppelin
배시 인터프리터 프로세스
501 51153 ?? 0:01.76 /Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/bin/java -Dfile.encoding=UTF-8 -Dlog4j.configuration=file:///Users/pgt0409/Desktop/git/zeppelin/conf/log4j.properties -Dlog4j.configurationFile=file:///Users/pgt0409/Desktop/git/zeppelin/conf/log4j2.properties -Dzeppelin.log.file=/Users/pgt0409/Desktop/git/zeppelin/logs/zeppelin-interpreter-sh-shared_process-pgt0409-parkgyeongtae-4.local.log -Xmx1024m -cp '':.//local-repo/sh/*:.//interpreter/sh/*:/Users/pgt0409/Desktop/git/zeppelin/zeppelin-interpreter-shaded/target/*:/Users/pgt0409/Desktop/git/zeppelin/zeppelin-zengine/target/test-classes/*:::/Users/pgt0409/Desktop/git/zeppelin/interpreter/zeppelin-interpreter-shaded-0.12.0-SNAPSHOT.jar:/Users/pgt0409/Desktop/git/zeppelin/zeppelin-interpreter/target/classes:/Users/pgt0409/Desktop/git/zeppelin/zeppelin-zengine/target/test-classes org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer 192.168.0.8 64093 sh-shared_process :
프로세스
/Users/pgt0409/Desktop/git/zeppelin
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/bin/java
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/jli/libjli.dylib
/Library/Preferences/Logging/.plist-cache.YOaXllgF
/private/var/folders/fh/6n18wmrn74vdv0lwcfcz3_r40000gn/T/hsperfdata_pgt0409/59262
/System/Library/CoreServices/SystemVersion.bundle/English.lproj/SystemVersion.strings
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libverify.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libjimage.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libzip.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libjava.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libextnet.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libnio.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libmanagement.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libmanagement_ext.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libnet.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/server/libjvm.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/modules
/usr/share/icu/icudt74l.dat
->0x3af8f02b411ce0d3
->0xce25b421ae03bef4
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/modules
/Users/pgt0409/Desktop/git/zeppelin/interpreter/sh/zeppelin-shell-0.12.0-SNAPSHOT.jar
/Users/pgt0409/Desktop/git/zeppelin/zeppelin-interpreter-shaded/target/original-zeppelin-interpreter-shaded-0.12.0-SNAPSHOT.jar
/Users/pgt0409/Desktop/git/zeppelin/zeppelin-interpreter-shaded/target/zeppelin-interpreter-shaded-0.12.0-SNAPSHOT.jar
/Users/pgt0409/Desktop/git/zeppelin/zeppelin-zengine/target/test-classes/commons-logging-1.1.1.jar
/Users/pgt0409/Desktop/git/zeppelin/zeppelin-zengine/target/test-classes/log4j-1.2.17.jar
/Users/pgt0409/Desktop/git/zeppelin/zeppelin-zengine/target/test-classes/slf4j-log4j12-1.7.10.jar
/Users/pgt0409/Desktop/git/zeppelin/zeppelin-zengine/target/test-classes/gson-2.2.jar
/Users/pgt0409/Desktop/git/zeppelin/zeppelin-zengine/target/test-classes/slf4j-api-1.7.10.jar
/Users/pgt0409/Desktop/git/zeppelin/interpreter/zeppelin-interpreter-shaded-0.12.0-SNAPSHOT.jar
/Users/pgt0409/Desktop/git/zeppelin/logs/zeppelin-interpreter-sh-shared_process-pgt0409-parkgyeongtae-4.local.log
->(none)
192.168.0.8:64425->218.38.137.27:64416
/Users/pgt0409/Desktop/git/zeppelin
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/bin/java
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/jli/libjli.dylib
/private/var/folders/fh/6n18wmrn74vdv0lwcfcz3_r40000gn/T/hsperfdata_pgt0409/59241
/System/Library/CoreServices/SystemVersion.bundle/English.lproj/SystemVersion.strings
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libverify.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libjimage.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libzip.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libjava.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libextnet.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libnio.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libmanagement.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libnet.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/libmanagement_ext.dylib
/Library/Preferences/Logging/.plist-cache.YOaXllgF
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/server/libjvm.dylib
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/modules
/usr/share/icu/icudt74l.dat
/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home/lib/modules
/Users/pgt0409/Desktop/git/zeppelin/interpreter/sh/zeppelin-shell-0.12.0-SNAPSHOT.jar
/Users/pgt0409/Desktop/git/zeppelin/zeppelin-interpreter-shaded/target/original-zeppelin-interpreter-shaded-0.12.0-SNAPSHOT.jar
/Users/pgt0409/Desktop/git/zeppelin/zeppelin-interpreter-shaded/target/zeppelin-interpreter-shaded-0.12.0-SNAPSHOT.jar
/Users/pgt0409/Desktop/git/zeppelin/zeppelin-zengine/target/test-classes/commons-logging-1.1.1.jar
/Users/pgt0409/Desktop/git/zeppelin/zeppelin-zengine/target/test-classes/log4j-1.2.17.jar
/Users/pgt0409/Desktop/git/zeppelin/zeppelin-zengine/target/test-classes/slf4j-log4j12-1.7.10.jar
/Users/pgt0409/Desktop/git/zeppelin/zeppelin-zengine/target/test-classes/gson-2.2.jar
/Users/pgt0409/Desktop/git/zeppelin/zeppelin-zengine/target/test-classes/slf4j-api-1.7.10.jar
/Users/pgt0409/Desktop/git/zeppelin/interpreter/zeppelin-interpreter-shaded-0.12.0-SNAPSHOT.jar
/Users/pgt0409/Desktop/git/zeppelin/logs/zeppelin-interpreter-sh-shared_process-pgt0409-parkgyeongtae-4.local.log
->(none)
[ctl com.apple.netsrc id 7 unit 57]
->0xa7bc80671d699352
*:64430
192.168.0.8:64447->218.38.137.27:64416
'Data Engineering > Zeppelin' 카테고리의 다른 글
| [Zeppelin] zeppelin/scripts/docker/zeppelin/bin/Dockerfile 분석 (0) | 2024.08.16 |
|---|---|
| [Zeppelin] 아파치 제플린이란 (0) | 2024.08.16 |
| [Zeppelin] 코드분석_20240726 (0) | 2024.07.26 |
| [Zeppelin] MacOS에 minikube 설치하는 방법 (0) | 2024.07.25 |
| [Zeppelin] Jira에 이슈 등록하고 PR 하는 방법 (0) | 2024.07.25 |
