Skip to main content

Documentation Index

Fetch the complete documentation index at: https://webscraping.titannet.io/docs/llms.txt

Use this file to discover all available pages before exploring further.

Titan is a web intelligence and automation platform. You define tasks that describe what to collect— from classic URL lists and output schemas to modular flows that combine search, crawl, scrape, and HTTP API steps. Titan runs that work on managed workers, tracks every execution, and exposes structured results, datasets, and media through stable HTTP APIs and the dashboard. Use these docs to learn the platform model, integrate with the Task Service, and see how billing, analytics, and worker types fit around the same task and execution identifiers.
New to Titan? Read What is Titan Web Scraping? and What can you build?, then follow the Quickstart. Prefer a system map first? Open Architecture.

Start here

What is Titan Web Scraping?

Platform scope: tasks, actions, workers, and why teams standardize on one control plane.

What can you build?

Patterns for agents, commerce, compliance, operations, and knowledge bases.

Quickstart

Authenticate, create a task, run it once, poll the execution, and export a result.

Authentication

JWTs and API keys for interactive apps and backend automation.

Task Service API

Programmatic task and execution lifecycle against Titan’s main public API.

Architecture overview

User layer, control plane, workers, and how a run flows end to end.

Explore the platform

Action types

Search, crawl, scrape, and API call—and how multi-step tasks compose them.

Tasks

Durable definitions: classic extraction and modular execution plans.

Executions

Lifecycle from queued run to completed output for any task shape.

Datasets and media

Structured output, datasets, and media-aware exports.

API reference

HTTP APIs (OpenAPI)

Open the API Reference tab for per-operation pages (Task, Analytics, and Billing) generated from OpenAPI, including parameters, responses, and optional try-it requests against your deployment base URL.

Build with the platform

Create and manage tasks

Create, update, and organize long-lived workflows and monitors.

Monitor executions

Poll execution state and apply runtime controls.

Download results

Export structured results, inspect datasets, and resolve media assets.

Templates and previews

Reusable patterns and short-lived preview runs before durable tasks.

Understand worker types

Browser node workers

How standalone Playwright and Puppeteer workers participate in execution.

Chrome extension workers

Extension-based execution and platform verification.

Data return flow

Ingestion path for structured output and media.

Security and trust

How Titan separates execution trust, ingestion, and public result access.

Example workflows

Single URL extraction

Validate the basic end-to-end API flow on one page.

Scheduled monitoring

Repeated execution and datasets over time.

Media-aware scraping

Structured fields plus media assets in one run.
  1. What is Titan Web Scraping?
  2. What can you build?
  3. Quickstart
  4. Authentication and API keys
  5. Architecture
  6. Action types overview
  7. Task Service API