Mindket
English
English简体中文
Sign inSign up
StoreMCPSkillsCalculatorLearnPriceBlog
Discover
Research311Writing59Business95Legal13Finance & accounting33Marketing & SEO175Developer1,420Productivity390Education81Companions14
Help and support
Language
English简体中文

Web page to structured JSON by OpenAI over a webhook

by Mindketn8n workflowDeveloper
Newversion 1 · updated
Nodes6Apps1Like

Overview

  1. Scrape URL
  2. Validate
  3. Fetch Page
  4. Extract Text
  5. AI: Extract Data
  6. Respond
Web page to structured JSON by OpenAI over a webhook, picture 1
‹2 / 2›

An n8n workflow that answers a webhook call with JSON taken from a web page. It checks the address, downloads the page, reduces it to text and asks OpenAI to pull out the fields the caller names.

Web page to structured JSON by OpenAI over a webhook is an n8n workflow in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page or copy its JSON, then import it into an n8n canvas. Nothing runs until you activate it in n8n.

At a glance

Runs in
  • n8n Cloud: import the file into a new workflow there
  • Your own n8n server: the same file and steps
  • Another n8n workflow: call it with an HTTP Request node
  • A script or an app: send a POST request with a JSON body

Platform

n8nWorkflow automation, in n8n’s cloud or on your own server
Connects 1 app

How it works

Trigger

Webhook call

It starts when a caller sends a POST request to its webhook address, with a JSON body:

  • url (required): the page to read
  • extract_fields: what to find, such as price,features
  • name: an optional label that is passed along but not used

Actions

  1. Validate checks the address and rejects anything that is not a public web address
  2. Fetch Page downloads the page with a GET request and waits up to 20 seconds
  3. Extract Text removes scripts, styles and tags and keeps the first 4,000 characters
  4. OpenAI (gpt-6-luna) pulls out the fields you named, plus a title, a description, statistics and a sentiment
  5. Respond sends that JSON back to the caller

Result

A JSON reply with a title, a description, the fields you asked for, a list of statistics and a sentiment word

Integrations

What you need before you start.

OpenAI

Language model

Runs gpt-6-luna to read the page text and write the JSON.

NeedsAn OpenAI API key

Workflow check

Checked by Mindket on 13 Nov 2026

Steps
6 steps, starting when its webhook is called
AI
1 step calls an AI model: AI: Extract Data
Sign-ins
No sign-in
API keys
No API key is left in the file
Step types
Mindket’s checker reads all 5 of its step types

Read from the workflow’s file, not from a run.

About

What it is

This n8n workflow turns a web address into structured data. A caller sends a POST request that names a page and the fields to look for. The workflow checks the address, downloads the page, strips it to plain text and asks OpenAI to pull out those fields. The reply is JSON. Six nodes do the work, beside one sticky note.

Who it suits

Developers and automation builders who want an address in and clean JSON out, to feed a script or another workflow. Skip it for pages that need a login or that fill in their content with a script, because it reads the page’s HTML only.

Who uses it, and how
IndustryWho uses itHow they use itExample
E-commercePricing analystsPull the price and features from a product page they trackAn analyst sends a product page address and logs the price and features from each reply.
MarketingContent managersSummarize a competitor’s article or landing pageA manager sends an article address and reads its title, a short description and its tone.
ResearchAnalystsTurn a list of pages into rows of dataAn analyst loops twenty addresses through the webhook from another workflow and collects the JSON.
SoftwareDevelopersUse it as a small extraction service inside an appA developer posts an address from a script and reads extractedData in the reply.

You need a little n8n: import a file, add an OpenAI credential, create one Header Auth credential and send a test request.

Where to use it

Any n8n that can reach the open web and OpenAI will run it. Callers reach it at its webhook address, so a script, another workflow or any tool that sends a POST request can use it.

  • n8n Cloud: import the file into a new workflow there
  • Your own n8n server: the same file and steps
  • Another n8n workflow: call it with an HTTP Request node
  • A script or an app: send a POST request with a JSON body

Setup

Download saves a zip with workflow.json and Mindket’s setup notes in your downloads folder. Two credentials are involved.

What you need first
NeedDetail
n8nOn n8n Cloud or on a server of your own
OpenAIAn API key, for an OpenAI credential
A secret for callersA long random value, for a Header Auth credential
  1. In n8n, create a workflow, open its menu, choose Import from File and pick workflow.json.
  2. Create a Header Auth credential with a header name such as X-API-Key and a long random value of your own. Select it in Scrape URL.
  3. Open AI: Extract Data, add an OpenAI credential with your key and check that Model reads gpt-6-luna.
  4. In Scrape URL, click Listen for test event. Send a POST request to the test address with your header and a body such as {"url": "https://example.com"}.
  5. Save the workflow and press Publish. Send real calls to the production address, the one with /webhook/ in it.

How to use it

Send a POST request with your secret in its header and a JSON body. url is required, extract_fields lists what to find, such as price,features, and name rides along without being used. The reply is the model’s JSON.

What to change for a different result
To changeWhere
The fields to findextract_fields in the request, or its default in Validate
The layout of the replyThe JSON layout in the system message of AI: Extract Data
The modelModel in AI: Extract Data
How much of the page is readThe cut at 4,000 characters in Extract Text
The pageurl in the request

Example

A pricing analyst posts the address of a kettle’s product page with extract_fields set to price,features. The workflow fetches the page, reduces it to text and sends the first 4,000 characters to the model.

The reply is JSON with a title, a description, an extractedData object that holds the price and the features, a statistics list and a sentiment word.

For newcomers and experts

If you are new. n8n draws a workflow as boxes joined by lines, and each box, a node, does one job. A webhook is an address that starts the workflow when something calls it. The caller waits while the boxes run, and the last box sends the answer back. Send one test request, then open each box to see what it passed on.

For experts. Scrape URL answers through Respond, so the caller gets the model’s JSON itself. Validate reads the body from body, falling back to the item, and rejects schemes other than http and https and addresses that name a private network.

Where to look closer
NodeWhat it doesWhat to know
Scrape URLWebhook 2, POST, path extract-page-data, Header Auth, answers from a nodeA run that fails before Respond leaves the caller with an n8n error, not JSON
ValidateCode 2, checks url and builds the itemIt blocks private hosts by name or number. A public name that points to a private address, or a redirect to one, is not caught
Fetch PageHTTP Request 4.2, GET with a 20 second timeoutIt announces itself as PageDataReader/1.0 and stops the run on an error status
Extract TextCode 2, removes scripts, styles and tagsIt keeps the first 4,000 characters of what is left
AI: Extract DataOpenAI 1.8, Message a model, with JSON output onThe system message spells out the JSON layout
RespondRespond to Webhook 1.1, JSONIt returns message.content, which is the parsed JSON

Good to know

The webhook fetches any public address a caller sends, so keep its secret to yourself.

  • Locked by default: Mindket’s copy asks callers for a header secret. The original copy had no check, so anyone who found its address could make your n8n fetch pages
  • Model: OpenAI’s deprecations page, read on 12 November 2026, lists gpt-4o-mini as shutting down on 14 January 2027, with gpt-6-luna as its replacement. Mindket’s copy uses gpt-6-luna
  • Settings left out: the original set a temperature of 0.2 and a limit of 800 tokens. The model’s page lists no temperature, and reasoning tokens would count against a small limit, so Mindket’s copy uses the node’s defaults
  • Plain pages only: a page that adds its content with a script, or sits behind a login, comes back nearly empty
  • Cut pages: only the first 4,000 characters of the page text reach the model
  • Site rules: sites set their own rules for automated reading. Check a site’s terms before you point the workflow at it
  • Billing: each call is one model request, billed by OpenAI
  • Your data: the page text goes to OpenAI, and the JSON goes back to the caller
  • Credentials: the JSON holds none, so add the OpenAI and Header Auth credentials yourself

README and files

README

Web page to structured JSON by OpenAI over a webhook

An n8n workflow that turns a web address into structured data. A caller sends a POST request that names a page and the fields to
look for. The workflow checks the address, downloads the page, reduces it to plain text and asks OpenAI to pull out those fields.
The reply is JSON.

What is inside

  • workflow.json: the workflow as n8n exports it, five working nodes, a webhook and one sticky note. It holds no credential.
  • README.md: these notes.

What we changed from the original copy

  • The webhook now asks callers for a Header Auth secret. The original copy had no check, so anyone who found its address could
    make your n8n fetch pages. The path changed from the product name to extract-page-data.
  • Validate now rejects any address that is not http or https and any host written as a private name or number (localhost,
    10.x.x.x, 192.168.x.x, 172.16.x.x to 172.31.x.x, 127.x.x.x, 169.254.x.x, .local, .internal).
  • In the original copy the OpenAI step used the older OpenAI node type with a version number that type does not have. n8n would
    not load it as written. Mindket's copy uses the current OpenAI node, Message a model (version 1.8), with the same two messages
    and JSON output turned on.
  • The model changed from gpt-4o-mini to gpt-6-luna, since OpenAI's deprecations page, read on 12 November 2026, lists
    gpt-4o-mini as shutting down on 14 January 2027 and names gpt-6-luna as its replacement.
  • The temperature (0.2) and the 800 token limit were dropped. The model's page lists no temperature, and reasoning tokens would
    count against a small limit.
  • The request header User-Agent now reads Mozilla/5.0 (compatible; PageDataReader/1.0), and the sticky note was rewritten.

Before you start

  • An n8n instance, on n8n Cloud or your own server.
  • An OpenAI API key.
  • A long random value of your own for the Header Auth credential.

Set it up

  1. In n8n, create a workflow, open its menu and choose Import from File. Pick workflow.json.
  2. Create a Header Auth credential with a header name such as X-API-Key and a long random value. Select it in Scrape URL.
  3. Open AI: Extract Data, add an OpenAI credential with your key and check that Model reads gpt-6-luna.
  4. In Scrape URL, click Listen for test event. Send a POST request to the test address with your header and a body such as
    {"url": "https://example.com"}.
  5. Save the workflow and press Publish. Send real calls to the production address, the one with /webhook/ in it.

How a run goes

  1. Scrape URL (Webhook 2) receives the POST request and checks the header secret. It answers later, from Respond.
  2. Validate (Code) reads url, extract_fields (default price,features,description) and name from the body and rejects a
    bad or private address.
  3. Fetch Page (HTTP Request 4.2) downloads the page with a GET request and a 20 second timeout.
  4. Extract Text (Code) removes scripts, styles and tags and keeps the first 4,000 characters.
  5. AI: Extract Data (OpenAI 1.8, Message a model) asks gpt-6-luna for JSON with title, description, extractedData,
    statistics and sentiment.
  6. Respond (Respond to Webhook 1.1) sends message.content, the parsed JSON, back to the caller.

Change the look

  • The fields to find: extract_fields in the request, or its default in Validate.
  • The layout of the reply: the JSON layout in the system message of AI: Extract Data.
  • The model: Model in AI: Extract Data.
  • How much of the page is read: the cut at 4,000 characters in Extract Text.

Good to know

  • Keep the header secret private: the webhook fetches any public address a caller sends. A public name that points to a private
    address, or a redirect to one, is not caught by Validate.
  • A page that adds its content with a script, or sits behind a login, comes back nearly empty.
  • A run that fails before Respond leaves the caller with an n8n error, not JSON.
  • Sites set their own rules for automated reading. Check a site's terms before you point the workflow at it.
  • Each call is one model request, billed by OpenAI, and the page text goes to OpenAI.
Files
NOTICE.md  626 B
README.md  4 KB
workflow.json  6 KB

3 files, 11 KB, downloaded as a zip.

What’s new

  • Version 1 · 2026-11-12

Reviews

No ratings yet

Write a review

No reviews yet.

More from Mindket

See all from Mindket

Huashu Design

alchaincyf · Skill

Turns a one-line request in your AI agent into a finished design: a launch animation, a clickable app prototype, an editable slide deck, an infographic or a se…

New29.4k

Guizang PPT Skill

op7418 · Skill

Skill that makes single-file HTML slide decks, slide illustrations and platform covers in two visual styles, with a presenter mode for rehearsal. For speakers…

New29.8k

Claude Code Skills & Plugins

alirezarezvani · Skill

Adds 411 ready-made skills for Claude Code and other coding agents, grouped by role from engineering and product to marketing, finance and compliance. Installs…

New29.8k

Similar in Developer

See all in Developer

buzz

block · Kit

Self-hostable workspace where people and AI agents share the same rooms, built on a Nostr relay that logs every action as a signed event. For teams that want t…

New37.3k

plannotator

backnotprop · Kit

Opens your AI coding agent's plans, specs and code changes in a browser so you can annotate or comment on them and send the feedback straight back to the agent.

New10.5k

open-code-review

alibaba · Kit

Reviews Git changes with an AI agent that reads files and searches the codebase, then writes comments tied to exact lines. It suits developers who want automat…

New50.7k