NMDC Updates

[mattldawson]

This PR modifies the NMDC database to request file information in batches. It also loosens the restriction on transferring raw data files and files with unknown workflow ID prefixes.

A few tests were also modified to avoid hard failures when you run locally with expired credentials, and to timeout for transfer requests that hang.

I'll leave this in draft until we have a chance to test actual NMDC transfers with these updates

[github-actions]

PR Preview Action v1.8.1
🚀 View preview at https://kbase.github.io/dts/pr-preview/pr-204/
Built to branch gh-pages at 2026-03-31 15:50 UTC. Preview will be ready when the GitHub Pages deployment is complete.

[codecov]

Codecov Report

❌ Patch coverage is 75.00000% with 9 lines in your changes missing coverage. Please review.
✅ Project coverage is 62.16%. Comparing base (597f7e9) to head (bf4d88a).

Files with missing lines	Patch %	Lines
databases/nmdc/database.go	73.52%	5 Missing and 4 partials ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #204      +/-   ##
==========================================
- Coverage   64.69%   62.16%   -2.54%     
==========================================
  Files          34       34              
  Lines        4501     4525      +24     
==========================================
- Hits         2912     2813      -99     
- Misses       1265     1399     +134     
+ Partials      324      313      -11     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.