Failed to iterate leveldb directory: Attempting to fetch value instead of handling error Not found (errno 2: No such file or directory)

[pradipaub36]

Step 0: Are you in the right place?

Yes

[REQUIRED] Step 1: Describe your environment

• Xcode version: 11.3.1
• Firebase SDK version: 6.24.0
• Firebase 6.24.0
• FirebaseABTesting 3.2.0
• FirebaseAnalytics 6.5.0
• FirebaseAuth 6.5.3
• FirebaseCore 6.7.0
• FirebaseCoreDiagnostics 1.3.0
• FirebaseCrashlytics 4.1.0
• FirebaseDatabase 6.2.1
• FirebaseFirestore 1.13.0
• FirebaseInAppMessaging 0.20.0
• FirebaseInstallations 1.2.0
• FirebaseInstanceID 4.3.4
• FirebaseMessaging 4.4.0
• Firebase Component: Auth, Database, Firestore, Messaging, Storage
• Component version: _____
• Installation method: CocoaPods

[REQUIRED] Step 2: Describe the problem

Our app is crashing with this error code. I couldn't find a way to reproduce this error.

Fatal Exception: NSInternalInconsistencyException
FIRESTORE INTERNAL ASSERTION FAILED: Attempting to fetch value instead of handling error Not found: Failed to stat file: /var/mobile/Containers/Data/Application/AC16519C-25FC-4CDA-A36B-FE5B7DC56C3B/Library/Application Support/firestore/__FIRAPP_DEFAULT/cubii-android/main/000057.ldb (errno 2: No such file or directory)
firebase::firestore::util::ObjcThrowHandler(firebase::firestore::util::ExceptionType, char const*, char const*, int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)

Fatal Exception: NSInternalInconsistencyException
0  CoreFoundation                 0x1ac9a096c __exceptionPreprocess
1  libobjc.A.dylib                0x1ac6b9028 objc_exception_throw
2  CoreFoundation                 0x1ac89d4fc +[_CFXNotificationTokenRegistration keyCallbacks]
3  Foundation                     0x1acd30474 -[NSAssertionHandler handleFailureInFunction:file:lineNumber:description:]
4  Cubii_Git                      0x101276578 firebase::firestore::util::ObjcThrowHandler(firebase::firestore::util::ExceptionType, char const*, char const*, int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) + 59 (exception_apple.mm:59)
5  Cubii_Git                      0x101276224 firebase::firestore::util::Throw(firebase::firestore::util::ExceptionType, char const*, char const*, int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) + 90 (exception.cc:90)
6  Cubii_Git                      0x1012c6178 firebase::firestore::util::internal::FailAssertion(char const*, char const*, int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, char const*) + 42 (hard_assert.cc:42)
7  Cubii_Git                      0x101329efc firebase::firestore::util::internal_statusor::Helper::Crash(firebase::firestore::util::Status const&) + 35 (statusor.cc:35)
8  Cubii_Git                      0x1012d7854 firebase::firestore::local::LevelDbPersistence::CalculateByteSize()
9  Cubii_Git                      0x1012ef974 firebase::firestore::local::LruGarbageCollector::Collect(std::__1::unordered_map<int, firebase::firestore::local::TargetData, std::__1::hash<int>, std::__1::equal_to<int>, std::__1::allocator<std::__1::pair<int const, firebase::firestore::local::TargetData> > > const&)
10 Cubii_Git                      0x1012ef474 std::__1::__function::__func<std::__1::enable_if<!(std::is_same<void, decltype(fp0())>::value), decltype(fp0())>::type firebase::firestore::local::Persistence::Run<firebase::firestore::local::LocalStore::CollectGarbage(firebase::firestore::local::LruGarbageCollector*)::$_16>(absl::lts_2020_02_25::string_view, firebase::firestore::local::LocalStore::CollectGarbage(firebase::firestore::local::LruGarbageCollector*)::$_16)::'lambda'(), std::__1::allocator<std::__1::enable_if<!(std::is_same<void, decltype(fp0())>::value), decltype(fp0())>::type firebase::firestore::local::Persistence::Run<firebase::firestore::local::LocalStore::CollectGarbage(firebase::firestore::local::LruGarbageCollector*)::$_16>(absl::lts_2020_02_25::string_view, firebase::firestore::local::LocalStore::CollectGarbage(firebase::firestore::local::LruGarbageCollector*)::$_16)::'lambda'()>, void ()>::operator()()
11 Cubii_Git                      0x1012d7bc8 firebase::firestore::local::LevelDbPersistence::RunInternal(absl::lts_2020_02_25::string_view, std::__1::function<void ()>)
12 Cubii_Git                      0x1012e99c4 firebase::firestore::local::LocalStore::CollectGarbage(firebase::firestore::local::LruGarbageCollector*)
13 Cubii_Git                      0x10129b350 std::__1::__function::__func<firebase::firestore::core::FirestoreClient::ScheduleLruGarbageCollection()::$_4, std::__1::allocator<firebase::firestore::core::FirestoreClient::ScheduleLruGarbageCollection()::$_4>, void ()>::operator()()
14 Cubii_Git                      0x1012572e4 firebase::firestore::util::AsyncQueue::ExecuteBlocking(std::__1::function<void ()> const&)
15 Cubii_Git                      0x1012768ec firebase::firestore::util::TimeSlot::InvokedByLibdispatch(void*)
16 libdispatch.dylib              0x1ac645fd8 _dispatch_client_callout
17 libdispatch.dylib              0x1ac648758 _dispatch_continuation_pop
18 libdispatch.dylib              0x1ac658f18 _dispatch_source_invoke2
19 libdispatch.dylib              0x1ac6588c4 _dispatch_source_invoke
20 libdispatch.dylib              0x1ac64c320 _dispatch_lane_serial_drain
21 libdispatch.dylib              0x1ac64ce7c _dispatch_lane_invoke
22 libdispatch.dylib              0x1ac655f20 _dispatch_workloop_worker_thread
23 libsystem_pthread.dylib        0x1ac6ab6d0 _pthread_wqthread
24 libsystem_pthread.dylib        0x1ac6b19e8 start_wqthread

Steps to reproduce:

I couldn't find a way to reproduce this error.

Relevant Code:

[google-oss-bot]

I found a few problems with this issue:

• I couldn't figure out how to label this issue, so I've labeled it for a human to triage. Hang tight.
• This issue does not seem to follow the issue template. Make sure you provide all the required information.

[var-const]

@pradipaub36 Sorry to hear about your issue. How often does this happen? Is it an isolated incident, or does this happen with any regularity?

From the call stack, it seems like one of the files in the LevelDb directory got deleted just as Firestore code was iterating over the directory. Is it possible that something in your app triggered the deletion? If not, it might be that LevelDb compaction happened to kick off during the iteration. If that's the case, we will put together a fix to make the relevant code tolerate file suddenly becoming unavailable during iteration.

[pradipaub36]

Hi @var-const

This issue has 5 crashes affecting 5 users in the duration of 48 hours.

Is it possible that something in your app triggered the deletion?
The app is not triggering anything for deletion.

[wilhuff]

A fix for this will go out with the next release.

[pradipaub36]

Hi @wilhuff,

May I get a tentative release date? So can make a plan accordingly to update the Firebase SDKs

[paulb777]

@pradipaub36 Tentatively targeted to the week of July 13th.