Skip to content

How to Test Microsoft Foundry Browser Automation Before Production

Test Microsoft Foundry Browser Automation across identity, actions, human takeover, and durable outcomes before production.

How to Test Microsoft Foundry Browser Automation Before Production

TL;DR: Microsoft Foundry Browser Automation is now generally available as a managed browser tool backed by Playwright Workspaces. Before production, test four boundaries separately: which networks and identities the agent can reach, which browser actions it may perform, whether a person can observe and take control safely, and whether the final business result persists after the session ends. Private website browsing is still in preview, so treat private-network access as a separate rollout decision.

Microsoft made the Browser Automation Tool generally available on October 19, 2026. The managed tool can browse public websites, work with private applications through Azure networking, reuse Foundry toolbox operations, show a live browser view, and let a person take control of the session.

That is more than a browser-control feature. It is production infrastructure that can cross identity boundaries, private routes, and state-changing business systems inside one run.

The release question is therefore not only, “Can the agent finish the task?” It is, “Can we explain and constrain how it reached the result, interrupt it safely, and prove what remained true afterward?”

This is source-backed analysis, not an executed experiment.

What Microsoft Foundry Browser Automation Adds

The current Microsoft documentation describes Browser Automation as a managed Model Context Protocol tool backed by Playwright Workspaces. A Foundry agent can navigate pages, interact with controls, extract information, and use enabled operations from the Browser Automation toolbox.

The release adds several production-relevant capabilities:

  • managed browser sessions instead of a team operating its own browser infrastructure;

  • access to public websites and private applications connected through supported Azure networking;

  • Foundry identity and role controls around the browser resource;

  • Live View for observing the current session;

  • Take control for handing the active browser to a person;

  • session history, screenshots, recordings, and other diagnostic evidence;

  • governance guidance for domains, credentials, roles, and state-changing actions.

The boundaries are not all at the same maturity level. Microsoft labels the Browser Automation Tool generally available, while private website browsing remains in preview. An independent technical recap published October 23 highlighted the same split and called out the surrounding networking, identity, region, and workspace requirements.

Do not turn one “GA” label into blanket approval for every deployment shape. Public browsing, private network access, state-changing tools, and human takeover need separate acceptance decisions.

Use a Four-Boundary Production Acceptance Matrix

A useful release test divides the system into four boundaries:

Boundary

What to test

Failure that should block production

Network and identity

Allowed domains, private routes, workspace identity, roles, credentials, and denied destinations

The agent reaches an unapproved route, uses the wrong identity, or crosses a tenant boundary

Enabled actions

Available browser operations, state-changing steps, approvals, retries, and duplicate protection

A restricted action is discoverable or executable, or a retry creates a second side effect

Human takeover

Live View accuracy, takeover trigger, control transfer, agent pause, and continuation behavior

The agent keeps acting while a person controls the browser, or resumes from stale state

Evidence and durable result

Session evidence, authoritative readback, cleanup, and incident ownership

The session reports success but the system of record disagrees or the result cannot be reviewed

Run at least one positive, negative, blocked, and recovered case for each boundary. A happy path proves only that one configuration worked once.

Boundary One Tests Network and Identity Scope

Start by writing the exact reachability contract.

For each representative task, record:

  • allowed public domains;

  • allowed private hostnames and routes;

  • explicitly denied destinations;

  • the Foundry project and Playwright Workspace;

  • the Microsoft Entra identity used by the agent;

  • assigned roles and resource scope;

  • where credentials or secrets are resolved;

  • region and networking dependencies;

  • the expected signed-in application identity.

Then test the contract from both sides.

A positive case should reach the required application with the expected identity. A negative case should attempt an unapproved hostname, route, tenant, or role and fail without leaking content. A stale-identity case should revoke or change permission and verify that a reused session does not silently retain authority.

Private browsing deserves its own rollout gate because it expands the blast radius from public web access into internal applications and data. Preview status does not mean unusable. It means the team should isolate the deployment, limit scope, and require stronger rollback and monitoring before treating it like a mature default.

The acceptance result should name who owns failures at this boundary. A network denial, identity mismatch, and application authorization failure may look similar in the browser but belong to different teams.

Boundary Two Tests Which Actions the Agent May Perform

A managed browser can expose a broad set of interaction tools. Availability is not authorization.

Inventory the enabled operations for the exact agent configuration. Separate them into three groups:

  1. Read-only: navigate, inspect, search, or extract without changing business state.

  2. Reversible: edit a draft, fill a form, or change a setting that can be restored predictably.

  3. Consequential: submit, purchase, publish, delete, invite, transfer, approve, or send.

For every consequential action, define:

  • the required starting state;

  • the user or service identity;

  • the permitted object and scope;

  • whether human approval is required;

  • the exact state change allowed;

  • the duplicate-protection or idempotency rule;

  • the authoritative readback;

  • the cleanup or compensating action;

  • the escalation owner.

Test restricted operations even when they are not expected in the happy path. The production question is not only whether the agent follows instructions. It is whether the platform and application prevent an unsafe action when instructions, page content, state, or retries go wrong.

A timeout needs special treatment. If the caller stops waiting, the browser or application may still complete the action. Before retrying a submission, inspect the system of record for a late success. “The second attempt worked” can hide two orders, two tickets, or two messages.

Boundary Three Tests Live View and Human Takeover

Live View and Take control can reduce risk only if the control transition is explicit and testable.

Exercise a run where the agent reaches a planned takeover point, such as:

  • a multifactor authentication prompt;

  • a payment or approval screen;

  • an ambiguous account choice;

  • a destructive action;

  • a challenge the agent cannot resolve safely.

Verify this sequence:

```text agent reaches takeover trigger → Live View shows the current page and relevant state → agent pauses before the consequential action → person takes control → person completes, cancels, or corrects the step → control returns through an explicit transition → agent refreshes its understanding of page and application state → workflow continues or stops under policy

```

The dangerous failure is split control. If the person and agent can both act, the same field may be edited twice or a submission may occur from stale context.

Test cancellation too. A person should be able to stop the workflow without the agent later resuming from an outdated page snapshot or repeating the interrupted action.

Finally, distinguish a manual rescue from a clean autonomous pass. Both may produce the intended result, but they have different reliability and staffing implications. Record takeover frequency, trigger, duration, outcome, and whether the agent resumed safely.

Boundary Four Tests Evidence and Durable Readback

Session evidence explains the path. It does not establish the final business truth by itself.

For each test run, preserve enough context to answer:

  • which agent, project, workspace, build, and identity ran;

  • which public and private routes were allowed;

  • which operations were enabled;

  • what the known starting state was;

  • which material browser actions occurred;

  • where the first mismatch appeared;

  • whether a person took control;

  • what the agent reported;

  • what the authoritative system reported afterward;

  • whether cleanup completed.

Then check the durable result outside the agent’s own success message.

For a submitted support case, read the ticket from the system of record and verify its fields exactly once. For a settings change, reload through a new session or query a read-only API. For a file, verify the stored object, metadata, and checksum. For an approval, verify the approval record and the resulting downstream state.

A useful outcome classification is:

  • clean pass: allowed path, no unplanned takeover, correct durable result;

  • recovered pass: a failure or takeover occurred, recovery stayed within policy, correct durable result;

  • false success: the agent reported success but the authoritative state disagreed;

  • unsafe or unresolved: a forbidden action, identity ambiguity, duplicate side effect, missing evidence, or unverifiable result occurred.

Do not collapse these outcomes into one completion rate. A recovered pass may be acceptable during a pilot and unacceptable at scale.

A Worked Release Checklist

Consider an agent that opens a private operations application, finds an account, updates its service tier, and confirms the change.

Before production, run these cases:

  1. Approved route and identity: the agent reaches only the private operations app and signs in as the intended limited role.

  2. Denied route: a link or redirect points to an unapproved internal host and access is blocked.

  3. Restricted action: the same role tries to delete the account and cannot discover or execute that operation.

  4. Duplicate protection: the update call times out, the test checks current state, and a retry does not apply the change twice.

  5. Takeover: the app requests human approval, the agent pauses, a person approves, and the agent rereads the current page before continuing.

  6. False-success check: the page displays “updated,” but a fresh read from the authoritative service confirms whether the tier actually changed.

  7. Cleanup: the test restores the approved fake-data account and closes the browser session.

The release does not pass because the final page looked correct. It passes when all four boundaries behave as designed and the authoritative result survives a fresh read.

What Changes as Managed Browser Agents Expand

Managed browser agents will increasingly cross public websites, private applications, and state-changing business systems inside one run, so the production test contract must make identity, network boundary, enabled tools, takeover state, and durable readback machine-readable rather than leaving them as implicit operator knowledge.

Before enabling a production workflow, record the allowed domains and private routes, Entra identity and roles, enabled MCP tools, state-changing steps, human takeover trigger, session evidence, authoritative final readback, cleanup result, and escalation owner.

This lets a solving agent or human reviewer distinguish an application defect from a network denial, identity error, forbidden operation, takeover failure, stale session, or false success without reconstructing the entire run from screenshots and prose.

Connect the Acceptance Contract to the Browser Path

Samelogic does not operate Microsoft Foundry. Its bounded browser-agent reliability pilot can use the agreed identity, network, and tool policy as conditions around a deliberately captured browser path and independently checked result.

The recording can help a reviewer inspect the visible state and ordered actions around the first mismatch. It does not replace Foundry configuration, application authorization, network controls, or an authoritative outcome check.

Teams preparing a managed browser workflow can review the browser agent regression test pilot.

The practical release rule is simple: approve the network, identity, action, takeover, and outcome boundaries separately. A browser agent is production-ready only when the team can constrain the path, interrupt it safely, and verify the result after the browser says it is done.

Sources

Related workflows

Move from editorial context into the selector, Playwright, and bug-reproduction pages that turn exact UI evidence into action.

Capture browser proof before the handoff gets vague.

Select the exact element, record the replay, and give QA, product, and engineering a test artifact they can act on without another clarification loop.

Install the Chrome Extension
Visual
Semantic
Behavioral

Used by teams at

  • abbott logo
  • accenture logo
  • aaaauto logo
  • abenson logo
  • bbva logo
  • bosch logo
  • brex logo
  • cat logo
  • carestack logo
  • cisco logo
  • cmacgm logo
  • disney logo
  • equipifi logo
  • formlabs logo
  • heap logo
  • honda logo
  • microsoft logo
  • procterandgamble logo
  • repsol logo
  • s&p logo
  • saintgobain logo
  • scaleai logo
  • scotiabank logo
  • shopify logo
  • toptal logo
  • zoominfo logo
  • zurichinsurance logo
  • geely logo