Crawler by NthDS

Turn Old Well Files into Data You Can Use

Classify first. Digitize what you need.

Drop in a folder. Crawler classifies every file and page first, so you can pick the document classes you need and digitize just those. The data comes back standardized by well and tied to depth, from mud weights and hydrocarbon indicators to formation tops and handwritten notes, and each finding links back to its page.

Request a DemoGo to Platform
CRAWLER + NDEPTH
45 seconds
Crawler and NDepth in 45 seconds. Public Wyoming wells, edited for length.

How It Crawls

Crawler Reads Every File, Whatever the Folder Is Called

There's a folder called temp(14) on your shared drive. It holds checkshots, core and well logs for a basin you're exploring, and nobody knows they're there because it's called temp(14). Crawler opens every folder you give it, skips duplicates, reads each page and sorts what it finds by well and document type. It reads contracts and invoices too. Subsurface data is where it's strongest.

Network DriveG&G ReportsContractsField RecordsWell LogsCore DataLeasesAFEsDSTsCompletionsLASTIFFPDFPDFDOCXPDFXLSPDFPDFIMGLASPDF0 / 22 scanned
Transparent Pipeline

Watch Every File Go from Folder to Library

Every run shows its work while it happens: what was scanned, which duplicates were skipped, what type each page was given, how many pages were extracted and how many records reached the library. You can follow any file from the folder to the library.

  1. 1. Sources

    Files scanned, page counts taken, duplicates skipped.

  2. 2. Classify

    Every page typed, with each class's share of the run.

  3. 3. Extract

    Fields and tables pulled from the pages you chose.

  4. 4. Compile

    Records and summaries built for each well.

  5. 5. Library

    Items added and ready to search, map and export.

Crawler run activity for a folder called generic-files: sources scanned, duplicates skipped, pages classified into G&G, operations and business types, then extracted, compiled and added to the library, every stage complete
A finished run on a folder called generic-files, every stage shown from scanned sources to the library. Click to open full size.
Classify First

Classify Everything. Digitize Only What You Need.

Run classification across the whole archive first and see what it holds. Then pick the document classes you want and digitize just those. A targeted pass spends credits on the pages you need and finishes sooner.

  1. 1. Classify the archive

    Analyze shows the file count and credit estimate before anything runs. Then every page gets a document type and the archive becomes searchable.

  2. 2. Pick the classes

    Choose from the typed quote: core analysis, formation tops, DSTs, completions, logs or whatever the job needs.

  3. 3. Digitize those

    Fields and tables come off only the pages you picked and compile into records by well.

  4. 4. QC and export

    Check each table against its source page in Compare, then export to CSV or Excel.

QC

QC the Data Against the Source Page

Open any file in Compare and the extracted table sits beside the original scan. Check a depth, a porosity value or a show against the page it came from, then download the data.

Compare

Extracted fields and tables beside the source page.

Identity review

Documents that can't be tied to a well are flagged.

Duplicates

Matched by file hash and skipped before the run.

Crawler Compare view: a core analysis table with depth, permeability, porosity and residual saturations, extracted beside the scanned source page
Compare view: a core analysis table extracted from a scanned well file, beside the source page. Click to open full size.
What Comes Back

Sorted by Well. Tied to Depth.

  • Formation tops and perforations. Normalized across wells.
  • Reported shows. By depth, with the evidence behind each one.
  • Mud weights, hydrocarbon indicators and handwritten notes. Tied to depth.
  • DSTs, core analysis and PVT. Grouped by well.
  • Well identity. API/UWI normalized, so each record lands on the right well.
Crawler Files and Data in the Wells view, listing each well with operator, field, document types, deepest depth and report years
Files & Data in the Wells view: each well with its operator, field, documents, deepest depth and report years. Click to open full size.
Deployment

Fits How Your Team Works

NDEX Public Catalog

Public well records beside your archive: headers, LAS curve inventory and reported shows where available. Catalog access is a workspace add-on; per-well purchases happen in the NDEX marketplace.

Exports and Integrations

Export to CSV or Excel. APIs, databases and connections to interpretation software are scoped to your systems.

Cloud or On-Premise

Use Crawler in the browser, or scope an on-premise or hybrid deployment around your network, authentication and retention requirements.

Built for subsurface data teams.

GeosciencePetrophysicsData ManagementA&DTechnical Services
FAQ

Frequently Asked Questions

What is NthDS Crawler?

Crawler turns well files and other energy documents into standardized, searchable data. It classifies every file and page, extracts records by well, ties them to depth and puts each extracted table beside its source page for QC. You can search the archive, map the wells and export to CSV or Excel.

Can I classify first and digitize later?

Yes. Run classification across the whole archive first: every page gets a document type and the archive becomes searchable. Then pick the document classes you want from the typed quote and digitize only those, so you spend credits on the pages you need.

What documents can Crawler read?

Crawler classifies reports, forms, permits, completions, maps, plots, drilling and production tables, core analysis, PVT, DSTs, surveys and logs. It also reads general business documents such as contracts and invoices. Classification reads each page, so file and folder names don't matter.

Can Crawler digitize oil and gas well documents?

Yes. Oil and gas well document digitization is what Crawler does: it classifies every page of a well file, extracts the fields and tables from the document classes you pick and compiles them into records by well. Log curves are a separate job: Nspect digitizes raster well logs to LAS.

Can I see what Crawler is doing during a run?

Yes. Each run shows its stages as they happen: files scanned and duplicates skipped, every page's document type, pages extracted, records compiled and items added to the library.

How do I check the extracted data?

Open any file in Compare. The extracted fields and tables sit beside the original page, so you can check each value against its source before you download it. Documents that can't be tied to a well are flagged for identity review.

How does NDEX work with Crawler?

The integrated NDEX public catalog lets teams explore public well records alongside their own archive, including well headers, LAS curve inventory, depth-indexed hydrocarbon shows, perforations, and reported temperatures where available. Filters help teams assess coverage and identify gaps. Catalog access is available as a workspace add-on. Buying individual wells inside Crawler is planned; current per-well purchases take place in the separate NDEX marketplace.

Can Crawler be deployed on-premise?

Discuss on-premise or hybrid deployment with the team. The deployment scope depends on your environment, network restrictions, authentication, retention, and acceptance requirements; these are agreed during technical scoping.

How does Crawler work with NDepth?

Crawler builds and organizes the data. NDepth answers plain-English questions on it, with source-page citations.

See Crawler on Your Own Files

Schedule a demo with the reports, logs and well files your team works with.

Request a Demo