EmbedderTest.FrameInfoContainsValidWidthAndHeight flaked on presubmit

[dnfield]

https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket.appspot.com/8847948180762954768/+/u/Host_Tests_for_host_profile/stdout#L40453_5

From flutter/engine#25991, which was changing Dart code unrelated to this test. I've been unable to reproduce locally.

[dnfield]

Failure happened again on presubmit, this time spitting out a backtrace (https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket.appspot.com/8847830236270803744/+/u/Host_Tests_for_host_profile/stdout#L40016_1):

 [ RUN      ] EmbedderTest.FrameInfoContainsValidWidthAndHeight
 [ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
 [ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
 [ERROR:flutter/fml/backtrace.cc(118)] Caught signal SIGSEGV during program execution.
 Frame 0: 0x10d88d7e5 std::__1::__function::__func<flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0, std::__1::allocator<flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0>, void ()>::operator()()�
 Frame 1: 0x10d5499fc fml::MessageLoopImpl::FlushTasks(fml::FlushType)�
 Frame 2: 0x10d55265c fml::MessageLoopDarwin::OnTimerFire(__CFRunLoopTimer*, fml::MessageLoopDarwin*)�
 Frame 3: 0x7fff2fa4c7f9 __CFRUNLOOP_IS_CALLING_OUT_TO_A_TIMER_CALLBACK_FUNCTION__
 Frame 4: 0x7fff2fa4c35f __CFRunLoopDoTimer
 Frame 5: 0x7fff2fa4be47 __CFRunLoopDoTimers
 Frame 6: 0x7fff2fa30bea __CFRunLoopRun
 Frame 7: 0x7fff2fa2fe3e CFRunLoopRunSpecific
 Frame 8: 0x10d5528be fml::MessageLoopDarwin::Run()�
 Frame 9: 0x10d549824 fml::MessageLoopImpl::DoRun()�
 Frame 10: 0x10d54fe8a void* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, fml::Thread::Thread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)::$_0> >(void*)�
 Frame 11: 0x7fff69ceb109 _pthread_start
 Frame 12: 0x7fff69ce6b8b thread_start

[dnfield]

@iskakaushik @cyanglaz @gw280 show up in git blame around these frames.

[cbracken]

I just saw this on the Mac shard of a Windows-specific change as well.

Build: https://ci.chromium.org/ui/p/flutter/builders/try/Mac%20Host%20Engine/23511/overview
Log: https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket.appspot.com/8847757221965554640/+/u/Host_Tests_for_host_debug_unopt/stdout

Log Snippet:

Running command "/opt/s/w/ir/cache/builder/src/out/host_debug_unopt/embedder_unittests --gtest_shuffle --gtest_repeat=2"
[INFO:test_timeout_listener.cc(76)] Test timeout of 30 seconds per test case will be enforced.

Repeating all tests (iteration 1) . . .

Note: Randomizing tests' orders with a seed of 30503 .
[==========] Running 94 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 2 tests from EmbedderTestNoFixture
[ RUN      ] EmbedderTestNoFixture.CanGetCurrentTimeInNanoseconds
[       OK ] EmbedderTestNoFixture.CanGetCurrentTimeInNanoseconds (0 ms)
[ RUN      ] EmbedderTestNoFixture.MustNotRunWithInvalidArgs
embedder.cc (912): 'FlutterEngineInitialize' returned 'kInvalidArguments'. The assets path in the Flutter project arguments was missing.
[       OK ] EmbedderTestNoFixture.MustNotRunWithInvalidArgs (0 ms)
[----------] 2 tests from EmbedderTestNoFixture (1 ms total)

[----------] 92 tests from EmbedderTest
[ RUN      ] EmbedderTest.CanSendLowMemoryNotification
[       OK ] EmbedderTest.CanSendLowMemoryNotification (117 ms)
[ RUN      ] EmbedderTest.NullPlatformMessagesCanBeSent
[       OK ] EmbedderTest.NullPlatformMessagesCanBeSent (88 ms)
[ RUN      ] EmbedderTest.ComplexClipsAreCorrectlyCalculated
[       OK ] EmbedderTest.ComplexClipsAreCorrectlyCalculated (949 ms)
[ RUN      ] EmbedderTest.CanReloadSystemFonts
[       OK ] EmbedderTest.CanReloadSystemFonts (95 ms)
[ RUN      ] EmbedderTest.CanInvokeCustomEntrypointMacro
[       OK ] EmbedderTest.CanInvokeCustomEntrypointMacro (87 ms)
[ RUN      ] EmbedderTest.CompositorMustBeAbleToRenderKnownScenePixelRatioOnSurfaceWithRootSurfaceXformation
[       OK ] EmbedderTest.CompositorMustBeAbleToRenderKnownScenePixelRatioOnSurfaceWithRootSurfaceXformation (2228 ms)
[ RUN      ] EmbedderTest.MustPreventEngineLaunchWhenRequiredCompositorArgsAreAbsent
[ERROR:flutter/shell/platform/embedder/embedder.cc(698)] Required compositor callbacks absent.
embedder.cc (1175): 'FlutterEngineInitialize' returned 'kInvalidArguments'. Compositor arguments were invalid.
[       OK ] EmbedderTest.MustPreventEngineLaunchWhenRequiredCompositorArgsAreAbsent (0 ms)
[ RUN      ] EmbedderTest.CustomCompositorMustWorkWithCustomTaskRunner
[       OK ] EmbedderTest.CustomCompositorMustWorkWithCustomTaskRunner (206 ms)
[ RUN      ] EmbedderTest.CanCreateAndCollectAValidElfSource
../../flutter/shell/platform/embedder/tests/embedder_unittests.cc:1187: Skipped

[  SKIPPED ] EmbedderTest.CanCreateAndCollectAValidElfSource (0 ms)
[ RUN      ] EmbedderTest.CompositorMustBeAbleToRenderToOpenGLTexture
[       OK ] EmbedderTest.CompositorMustBeAbleToRenderToOpenGLTexture (121 ms)
[ RUN      ] EmbedderTest.CanSetCustomLogTag
[       OK ] EmbedderTest.CanSetCustomLogTag (88 ms)
[ RUN      ] EmbedderTest.CompositorMustBeAbleToRenderKnownSceneMetal
[       OK ] EmbedderTest.CompositorMustBeAbleToRenderKnownSceneMetal (329 ms)
[ RUN      ] EmbedderTest.CanCreateAndCollectCallbacks
[       OK ] EmbedderTest.CanCreateAndCollectCallbacks (87 ms)
[ RUN      ] EmbedderTest.CompositorMustBeAbleToRenderKnownSceneWithSoftwareCompositor
[       OK ] EmbedderTest.CompositorMustBeAbleToRenderKnownSceneWithSoftwareCompositor (296 ms)
[ RUN      ] EmbedderTest.CompositorCanPostOnlyPlatformViews
[       OK ] EmbedderTest.CompositorCanPostOnlyPlatformViews (242 ms)
[ RUN      ] EmbedderTest.CompositorRenderTargetsAreInStableOrder
[       OK ] EmbedderTest.CompositorRenderTargetsAreInStableOrder (1951 ms)
[ RUN      ] EmbedderTest.InvalidPlatformMessages
embedder.cc (1622): 'FlutterEngineSendPlatformMessage' returned 'kInvalidArguments'. Message size was non-zero but the message data was nullptr.
[       OK ] EmbedderTest.InvalidPlatformMessages (86 ms)
[ RUN      ] EmbedderTest.CanSetCustomLogMessageCallback
[       OK ] EmbedderTest.CanSetCustomLogMessageCallback (88 ms)
[ RUN      ] EmbedderTest.KeyDataIsCorrectlySerialized
[       OK ] EmbedderTest.KeyDataIsCorrectlySerialized (104 ms)
[ RUN      ] EmbedderTest.InvalidAOTDataSourcesMustReturnError
../../flutter/shell/platform/embedder/tests/embedder_unittests.cc:1127: Skipped

[  SKIPPED ] EmbedderTest.InvalidAOTDataSourcesMustReturnError (0 ms)
[ RUN      ] EmbedderTest.FrameInfoContainsValidWidthAndHeight
[ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(25)] Trying to embed a platform view but the PrerollContext does not support embedding
[ERROR:flutter/flow/layers/platform_view_layer.cc(41)] Trying to embed a platform view but the PaintContext does not support embedding
[FATAL:flutter/fml/memory/ref_ptr.h(120)] Check failed: ptr_. 
[ERROR:flutter/fml/backtrace.cc(118)] Caught signal SIGABRT during program execution.
Frame 0: 0x7fff6e6ad808 abort
Frame 1: 0x1082d8e29 fml::KillProcess()�
Frame 2: 0x1082d8de6 fml::LogMessage::~LogMessage()�
Frame 3: 0x1082d8e53 fml::LogMessage::~LogMessage()�
Frame 4: 0x107464f8b fml::RefPtr<fml::TaskRunner>::operator->() const�
Frame 5: 0x10914ab64 flutter::VsyncWaiter::ResumeDartMicroTasks()�
Frame 6: 0x109153471 flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0::operator()() const�
Frame 7: 0x1091532eb decltype(std::__1::forward<flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0&>(fp)()) std::__1::__invoke<flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0&>(flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0&)�
Frame 8: 0x10915324b void std::__1::__invoke_void_return_wrapper<void>::__call<flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0&>(flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0&)�
Frame 9: 0x1091531fb std::__1::__function::__alloc_func<flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0, std::__1::allocator<flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0>, void ()>::operator()()�
Frame 10: 0x109150d87 std::__1::__function::__func<flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0, std::__1::allocator<flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0>, void ()>::operator()()�
Frame 11: 0x107445820 std::__1::__function::__value_func<void ()>::operator()() const�
Frame 12: 0x107445533 std::__1::function<void ()>::operator()() const�
Frame 13: 0x1082dcbe5 fml::MessageLoopImpl::FlushTasks(fml::FlushType)�
Frame 14: 0x1082dca78 fml::MessageLoopImpl::RunExpiredTasksNow()�
Frame 15: 0x1082fee60 fml::MessageLoopDarwin::OnTimerFire(__CFRunLoopTimer*, fml::MessageLoopDarwin*)�
Frame 16: 0x7fff345447f9 __CFRUNLOOP_IS_CALLING_OUT_TO_A_TIMER_CALLBACK_FUNCTION__
Frame 17: 0x7fff3454435f __CFRunLoopDoTimer
Frame 18: 0x7fff34543e47 __CFRunLoopDoTimers
Frame 19: 0x7fff34528bea __CFRunLoopRun
Frame 20: 0x7fff34527e3e CFRunLoopRunSpecific
Frame 21: 0x1082ff2e4 fml::MessageLoopDarwin::Run()�
Frame 22: 0x1082dc9e7 fml::MessageLoopImpl::DoRun()�
Frame 23: 0x1082db4eb fml::MessageLoop::Run()�
Frame 24: 0x1082f8075 fml::Thread::Thread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)::$_0::operator()() const�
Frame 25: 0x1082f7f2b decltype(std::__1::forward<fml::Thread::Thread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)::$_0>(fp)()) std::__1::__invoke<fml::Thread::Thread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)::$_0>(fml::Thread::Thread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)::$_0&&)�
Frame 26: 0x1082f7e33 void std::__1::__thread_execute<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, fml::Thread::Thread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)::$_0>(std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, fml::Thread::Thread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)::$_0>&, std::__1::__tuple_indices<>)�
Frame 27: 0x1082f77b6 void* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, fml::Thread::Thread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)::$_0> >(void*)�
Frame 28: 0x7fff6e7e3109 _pthread_start
Frame 29: 0x7fff6e7deb8b thread_start



!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!


Failed Command:

/opt/s/w/ir/cache/builder/src/out/host_debug_unopt/embedder_unittests --gtest_shuffle --gtest_repeat=2

Exit Code: -6

[chinmaygarde]

We should be seeing a backtrace now on non-Windows failures.

[cbracken]

Interesting. I saw this in ShellTest.InitializeWithMultipleThreadButCallingThreadAsPlatformThread today:

Build: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20Host%20Engine/10062/overview
Log: https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket.appspot.com/8847392085514750000/+/u/Host_Tests_for_host_profile/stdout

Repeating all tests (iteration 1) . . .

Note: Randomizing tests' orders with a seed of 45502 .
[==========] Running 95 tests from 8 test suites.
[----------] Global test environment set-up.
[----------] 66 tests from ShellTest
[ RUN      ] ShellTest.InitializeWithMultipleThreadButCallingThreadAsPlatformThread
[ERROR:flutter/fml/backtrace.cc(118)] Caught signal SIGSEGV during program execution.
Frame 0: 0x1077f525e flutter::VsyncWaiter::ResumeDartMicroTasks()�
Frame 1: 0x1077f6195 std::__1::__function::__func<flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0, std::__1::allocator<flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0>, void ()>::operator()()�
Frame 2: 0x1078269cc fml::MessageLoopImpl::FlushTasks(fml::FlushType)�
Frame 3: 0x10782fddc fml::MessageLoopDarwin::OnTimerFire(__CFRunLoopTimer*, fml::MessageLoopDarwin*)�
Frame 4: 0x7fff369ea7f9 __CFRUNLOOP_IS_CALLING_OUT_TO_A_TIMER_CALLBACK_FUNCTION__
Frame 5: 0x7fff369ea35f __CFRunLoopDoTimer
Frame 6: 0x7fff369e9e47 __CFRunLoopDoTimers
Frame 7: 0x7fff369cebea __CFRunLoopRun
Frame 8: 0x7fff369cde3e CFRunLoopRunSpecific
Frame 9: 0x10783003e fml::MessageLoopDarwin::Run()�
Frame 10: 0x1078267f4 fml::MessageLoopImpl::DoRun()�
Frame 11: 0x10782d51a void* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, fml::Thread::Thread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)::$_0> >(void*)�
Frame 12: 0x7fff70c89109 _pthread_start
Frame 13: 0x7fff70c84b8b thread_start

[zanderso]

Another here: https://ci.chromium.org/ui/p/flutter/builders/try/Mac%20Host%20Engine/23904/overview. It looks like all of these have flutter::VsyncWaiter::ResumeDartMicroTasks(). Maybe there is an Engine shutdown race? /cc @iskakaushik

[zanderso]

Not sure if this is the same, but it is certainly in the same neighborhood:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20Host%20Engine/10320/overview

[ RUN      ] EmbedderTest.PushingMutlipleFramesSetsUpNewRecordingCanvasWithCustomCompositor
[ERROR:flutter/fml/backtrace.cc(118)] Caught signal SIGSEGV during program execution.
Frame 0: 0x10c169ba5 std::__1::__function::__func<flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0, std::__1::allocator<flutter::VsyncWaiter::FireCallback(fml::TimePoint, fml::TimePoint, bool)::$_0>, void ()>::operator()()�
Frame 1: 0x10be207dc fml::MessageLoopImpl::FlushTasks(fml::FlushType)�
Frame 2: 0x10be2943c fml::MessageLoopDarwin::OnTimerFire(__CFRunLoopTimer*, fml::MessageLoopDarwin*)�
Frame 3: 0x7fff3858f7f9 __CFRUNLOOP_IS_CALLING_OUT_TO_A_TIMER_CALLBACK_FUNCTION__
Frame 4: 0x7fff3858f35f __CFRunLoopDoTimer
Frame 5: 0x7fff3858ee47 __CFRunLoopDoTimers
Frame 6: 0x7fff38573bea __CFRunLoopRun
Frame 7: 0x7fff38572e3e CFRunLoopRunSpecific
Frame 8: 0x10be2969e fml::MessageLoopDarwin::Run()�
Frame 9: 0x10be20604 fml::MessageLoopImpl::DoRun()�
Frame 10: 0x10be26c6a void* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, fml::Thread::Thread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)::$_0> >(void*)�
Frame 11: 0x7fff7282e109 _pthread_start
Frame 12: 0x7fff72829b8b thread_start

Whether these are the same or different, we need to get to the bottom of some or all of them. These are closing the tree too much, so I'll bump this up to a P1.

Since it sounds like these are difficult to repro, we should probably have multiple folks taking a look. @iskakaushik can you take another look? Who else can help? Maybe @cbracken or @dnfield ?