Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- Loading checkpoint: checkpoints/needle.pkl
- Failed to find host bounds for accelerator type: WARNING: could not determine TPU accelerator type, please set env var `TPU_ACCELERATOR_TYPE` manually, otherwise libtpu.so may not properly initialize.
- WARNING: Logging before InitGoogle() is written to STDERR
- E0000 00:00:1778617309.503639 568 common_lib.cc:518] INVALID_ARGUMENT: Error: unexpected worker hostname 'WARNING: could not determine TPU worker hostnames or IP addresses' from env var TPU_WORKER_HOSTNAMES. Expecting a valid hostname or IP address without port number, or hostname:port:address triple. (Full TPU workers' addr string: WARNING: could not determine TPU worker hostnames or IP addresses, please set env var `TPU_WORKER_HOSTNAMES` manually, otherwise libtpu.so may not properly initialize.)
- === Source Location Trace: ===
- learning/45eac/tfrc/runtime/libtpu_init_utils.cc:311
- https://symbolize.stripped_domain/r/?trace=7d3d2df5550b,7d3e564298ef,7d3d2df5415c,7d3d2e5404d5,7d3e564831b8,7d3e5650821b&map=
- *** SIGSEGV (@0x79f), si_code=1, see go/stacktraces#s15 received by PID 568 (TID 630) on cpu 8; stack trace: ***
- https://symbolize.stripped_domain/r/?trace=7d3d2df50140,7d3e564298ef,7d3d2df4f857,7d3d2e5404d5,7d3e564831b8,7d3e5650821b&map=
- E0512 21:21:49.529129 628 process_state.cc:1066] RAW: Signal 11 raised at PC: 0x7d3d2df50140 while already in FailureSignalHandler!
- E0512 21:21:49.529727 628 process_state.cc:1070] RAW: tid: 628 raised new signal (old_tid: 630)
- PC: @ 0x7d3d2df5550b (unknown) eventmanager::EventManager2::Worker::Run<>()
- @ 0x7d3d2e6b7d83 1888 FailureSignalHandler()
- @ 0x7d3e564298f0 (unknown) (unknown)
- @ 0x7d3d2df5415d 80 absl::internal_any_invocable::LocalInvoker<>()
- @ 0x7d3d2e5404d6 256 Thread::ThreadBody()
- @ 0x7d3e564831b9 288 (unknown)
- @ 0x7d3e5650821c (unknown) (unknown)
- https://symbolize.stripped_domain/r/?trace=7d3d2df5550b,7d3d2e6b7d82,7d3e564298ef,7d3d2df5415c,7d3d2e5404d5,7d3e564831b8,7d3e5650821b&map=
- E0512 21:21:49.617725 630 coredump_hook.cc:310] RAW: Remote crash data gathering hook invoked.
- E0512 21:21:49.617737 630 client.cc:261] RAW: Coroner client retries enabled, will retry for up to 30 sec.
- E0512 21:21:49.617739 630 coredump_hook.cc:405] RAW: Sending fingerprint to remote end.
- E0512 21:21:49.617758 630 coredump_hook.cc:415] RAW: Cannot send fingerprint to Coroner: [NOT_FOUND] stat failed on crash reporting socket /var/google/services/logmanagerd/remote_coredump.socket (Is the listener running?): No such file or directory
- E0512 21:21:49.617761 630 coredump_hook.cc:467] RAW: Dumping core locally.
- base/elfcore.c:2139 Failed to write mapping 2 at 0x7d3ca48a6000 of size 16384: Bad address(14)
- Model parameters: 26,315,421
- Needle UI: http://127.0.0.1:7860
- Segmentation fault needle playground
Advertisement
Add Comment
Please, Sign In to add comment