Data Testing (Playwright) - 100% Remote
Location - 100% Remote
Job Type - Contract
Budget - 1.5 LPM
Shift timings - 1.30 PM to 9.30 PM IST
Experience - 5+ Years
Key Responsibilities
Microsoft Fabric Quality Engineering:
Design, develop, and execute comprehensive test strategies for Microsoft Fabric solutions.
Validate end-to-end data ingestion, transformation, and analytics workflows across
OneLake, Lakehouse, Warehouse, Data Factory, Dataflows Gen2, Spark Notebooks, and Semantic Models.
Perform functional, integration, regression, system, and user acceptance testing for Fabric
workloads.
Validate data quality, business rules, schema evolution, incremental data loads, and data
reconciliation across bronze, silver, and gold data layers.
Test Power BI Semantic Models, Direct Lake datasets, reports, dashboards, DAX calculations,
RLS and OLS.
Validate CI/CD deployments, Git integration, deployment pipelines, and promotions across
Development, Test, UAT, and Production.
Execute performance, scalability, concurrency, and workload testing for Fabric capacities.
Validate monitoring, logging, alerting, observability, and operational readiness.
Identify, document, prioritize, and track defects using Azure DevOps.
Develop reusable automation frameworks for Fabric testing.
Microsoft Fabric Data Agents & Agentic AI Testing:
Validate Microsoft Fabric Data Agents and AI-powered conversational analytics experiences.
Test natural language queries against structured and unstructured enterprise data.
Verify response accuracy, completeness, consistency, and relevance.
Validate grounding using OneLake, Lakehouse, Warehouse, and Semantic Models.
Test agent orchestration, tool calling, workflow execution, and Azure AI integrations.
Validate multi-step reasoning and autonomous agent interactions.
Test edge cases, ambiguous prompts, and error scenarios.
Perform prompt injection, jailbreak, adversarial prompt, and AI security testing.
Validate RLS, OLS, RBAC, and workspace security enforcement.
Develop automated tests for conversational AI, prompt regression, and response evaluation.
Required Skills
Microsoft Fabric, OneLake, Lakehouse, Data Warehouse, Data Factory, Dataflows Gen2,
Spark Notebooks, Semantic Models, Power BI, Direct Lake.
Microsoft Copilot, GitHub Copilot, Claude AI, Azure OpenAI, Agentic AI, Fabric Data Agents,
Prompt Engineering, RAG.
Playwright, Python, SQL, API Testing, Data Testing, Azure DevOps, CI/CD.