How to Use ScrAPI MCP Server with Bifrost
Web scraping using ScrAPI. Extract website content that is difficult to access because of bot detection, captchas or even geolocation restrictions.
[ MCP SERVER SUMMARY ]
ScrAPI MCP server summary
Web scraping using ScrAPI. Extract website content that is difficult to access because of bot detection, captchas or even geolocation restrictions. Connect ScrAPI through Bifrost MCP Gateway to centralize access control, virtual keys, and tool-call observability for your AI assistants.
| Property | Details |
|---|---|
| Company | Upstream maintainer |
| Connection type | Confirm upstream transport |
| Authentication | Varies by upstream server |
| Package or endpoint | See upstream documentation |
| Capabilities | ScrAPI tools over MCP, AI assistant connectivity, Governed tool access through Bifrost |
| Official documentation | ScrAPI MCP documentation |
Before you start
- Review the ScrAPI upstream documentation for its installation requirements
- Obtain any credentials required by the upstream service
- A running Bifrost MCP Gateway instance
What you can do with ScrAPI
- Web scraping using ScrAPI. Extract website content that is difficult to access because of bot detection, captchas or even geolocation restrictions.
- Expose ScrAPI tools to Claude, Cursor, and other MCP clients through one endpoint
- Apply virtual keys, tool allowlists, and audit logging at the gateway
[ HOW TO CONNECT ]
Connect ScrAPI to Bifrost in three steps
Install Bifrost
Start the gateway locally or deploy in your VPC.
npx -y @maximhq/bifrost
Add ScrAPI in MCP Gateway
Open MCP Gateway in the Bifrost dashboard, click New MCP Server, and select the transport documented by the upstream server. Or register via the API below.
• Confirm the transport, command or endpoint, and authentication requirements in the ScrAPI upstream documentation.
• Replace every placeholder in the example before sending the request.
Point clients at Bifrost /mcp
Configure Claude Desktop, Cursor, or Claude Code to use your Bifrost endpoint with a virtual key instead of connecting directly to ScrAPI.
{
"mcpServers": {
"bifrost": {
"url": "http://localhost:8080/mcp",
"headers": {
"Authorization": "Bearer vk_your_virtual_key"
}
}
}
}[ EXAMPLE CONFIG ]
Register ScrAPI via API
Add this MCP client with a POST to /api/mcp/client. See Connecting to MCP Servers for full options.
# For a remote HTTP or SSE server:
curl -X POST http://localhost:8080/api/mcp/client \
-H "Content-Type: application/json" \
-d '{
"name": "scrapi",
"connection_type": "<http|sse>",
"connection_string": "<upstream MCP endpoint>",
"tools_to_execute": ["*"]
}'
# For a local STDIO server:
curl -X POST http://localhost:8080/api/mcp/client \
-H "Content-Type: application/json" \
-d '{
"name": "scrapi",
"connection_type": "stdio",
"stdio_config": {
"command": "<upstream command>",
"args": ["<arg>"]
},
"tools_to_execute": ["*"]
}'[ WHY BIFROST ]
Run ScrAPI through one governed gateway
Access control
Virtual keys, RBAC, and tool allowlists per team or agent.
Cost governance
Attribute MCP tool spend alongside LLM usage in one view.
Observability
Log every tool call with latency, server, and virtual key metadata.
Credential isolation
Upstream secrets stay in the gateway — not on every laptop.
[ FAQ ]
Common questions
What does the ScrAPI MCP server do?
Web scraping using ScrAPI. Extract website content that is difficult to access because of bot detection, captchas or even geolocation restrictions. The exact tools available depend on the upstream server version and configuration.
How do I connect ScrAPI to Bifrost?
Check the upstream documentation to determine whether ScrAPI uses STDIO, Streamable HTTP, or SSE. Then add it as an MCP client in Bifrost using the corresponding command or endpoint.
Does Bifrost replace the ScrAPI MCP server?
No. Bifrost connects to ScrAPI as an upstream MCP client and adds a governed gateway between that server and your AI assistants.
[ RELATED SERVERS ]
More MCP integrations
Rube
Rube is a Model Context Protocol (MCP) server that connects your AI tools to 500+ apps like Gmail, Slack, GitHub, and Notion. Simply install it in your AI client, authenticate once with your apps, and start asking your AI to perform real actions like "Send an email" or "Create a task."
SafeDep
SafeDep `vet-mcp` helps in vetting open source packages for security risks, such as vulnerabilities and malicious code, before they're used in your project, especially with AI-generated code suggestions.
SafeLine
SafeLine is a self-hosted WAF(Web Application Firewall) to protect your web apps from attacks and exploits.