feat: add MrScraper integration

[ai-mrscraper]

Related Issues

• Related to New Integration Proposal: MrScraper Components and Agent Tools #3928 — MrScraper integration proposal (closed as not planned)
• Resubmission of feat: add MrScraper integration #3898, which was closed by the CLA gate

Proposed Changes

Adds the mrscraper-haystack integration for the MrScraper API. It includes 15 Haystack components for account information, URL discovery, Google search, page and structured-data extraction, result retrieval, scraper creation, and saved scraper runs. Each component supports synchronous and asynchronous execution. MrScraperToolset exposes the operations as Agent tools.

The package also includes API documentation, usage examples, unit tests, type checking, and a dedicated CI workflow. This branch has been updated with current upstream main.

How did you test it?

From integrations/mrscraper:

hatch run test:unit     # 111 passed, 1 live test deselected
hatch run fmt-check     # passed
hatch run test:types    # passed

Live API testing requires a MrScraper API key and was not run in this update.

Notes for the reviewer

We saw the recommendation on #3928 to publish this integration independently. We are resubmitting the implementation for consideration and understand if the core integration decision remains unchanged.

[ai-mrscraper]

Hi Deepset team @HaystackBot @anakin87 ,

Just a quick update from our side: we have already signed the Contributor License Agreement (CLA).

We have also submitted the proposal for the MrScraper integration, including the proposed components and implementation, for your review.

Please let us know if there’s anything else needed from our side or if any changes are required to move the integration forward.

Thank you!

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[HaystackBot]

Hi @ai-mrscraper, thanks a lot for your contribution! 🙏

We noticed that the Contributor License Agreement (CLA) check (license/cla) hasn't passed yet, so we've temporarily moved this PR to draft and paused the review assignment.

To get your PR reviewed, please sign the CLA via the link in the license/cla check below (or in the CLA bot comment). As soon as the check turns green, this PR will automatically be marked ready for review again and a reviewer will be re-assigned.

[ai-mrscraper]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Hi, thank you for the update. I have already signed the Contributor License Agreement

Could you please recheck the CLA status for PR #3988? I have also used the “recheck” link provided.

Thank you!

[HaystackBot]

Hi @ai-mrscraper, just a friendly reminder: this PR is still in draft because the Contributor License Agreement (CLA) hasn't been signed yet. We'd love to review your contribution! Please sign the CLA via the link in the license/cla check, and this PR will automatically be marked ready for review.