ChatGPT Voice Dictation Silently Discards Audio on Mid-Recording Screen Rotation
ChatGPT's Android voice dictation silently discards audio recorded before a mid-recording screen rotation, reproducible on every attempt.
Read ReportQualura is a senior-only QA agency for teams building AI products. We find the failures traditional QA can't see. Hallucinations, silent state breaks, quiet decision drift. All before your users do.
AI products fail in places traditional QA can't see. Hallucinated answers. Silent API timeouts. Agents choosing the wrong tool confidently. Regressions where responses stay "valid" but become less trustworthy over time.
AI QA demands a different toolkit. We focus on LLM apps, AI agents, RAG systems, copilots, and automation-heavy workflows where correctness matters more than polish. No vague reports. Just evidence of what's broken and what to fix first.
Evidence from real exploratory testing across AI products, model behavior, mobile workflows, and grounding failures.
ChatGPT's Android voice dictation silently discards audio recorded before a mid-recording screen rotation, reproducible on every attempt.
Read ReportWe tested ChatGPT, Gemini, and Grok with a prompt referencing an uploaded image when no image existed. Two models generated content anyway.
Read ReportHEIC images shared into ChatGPT through the Android system share sheet fail silently, causing unrelated generated output.
Read ReportFive days. Five specialists. One clear answer on whether your LLM product, AI agent, RAG system, or AI workflow is ready to ship.
We map your product, capture baseline behavior, and start probing the model itself, prompt adherence, hallucinations, tone drift, refusal patterns.
Deep functional paths. What happens on retry, on stop, on refresh. Chat history, session state, context windows, every place state can quietly break.
Concurrent requests, adversarial inputs, unusual locales, long inputs, empty inputs. WCAG audit on every interactive surface, including streamed responses.
Prompt injection, data leakage, auth boundaries, API integration points. The silent errors that don't surface to the user but corrupt trust over time.
Cross-device validation, regression sweep, and synthesis of every finding into an executive summary, risk framework, and a clear Go / No-Go recommendation.
Fixed scope. Fixed duration. Limited sprints per month.
Six pillars of AI quality assurance for LLM products, agents, RAG systems, and AI-powered workflows.
Prompt adherence, hallucinations, tool-selection errors, consistency across reruns, refusal quality, and eval drift over time.
Every user-facing flow, including retries, stops, edits, regenerations, and long-running conversations where state quietly drifts.
Streamed rendering, chat history, context persistence, session recovery, rapid-click edge cases, and visual regressions.
Prompt injection, data leakage, rate limits, auth boundaries, concurrent request handling, and integration failure paths.
WCAG 2.2 compliance, keyboard navigation, screen reader support for live-updating and streamed AI content.
Time-to-first-token, perceived latency, concurrent load, and degradation under real-world network conditions.
For teams that need more than a 5-day audit, we run ongoing AI testing engagements tailored to your product, model stack, and release risk.
Human-led testing for hallucinations, grounding gaps, missing context, false assumptions, and user journeys automation will not naturally explore.
Prompt adherence, retrieval quality, citation accuracy, context use, refusal behavior, and answer reliability across realistic prompt variation.
Tool selection, memory, state, permissions, retries, approval gates, and multi-step task completion for autonomous and semi-autonomous agents.
Real iOS and Android testing for voice, image upload, share intents, orientation changes, file handling, and cross-device AI workflows.
Testing the invisible layer behind AI features: tool calls, data integrity, auth boundaries, rate limits, failed dependencies, and silent server errors.
WCAG coverage for AI interfaces, including streamed responses, chat controls, generated content, keyboard flows, screen readers, and error states.
We specialize in LLM products, AI agents, copilots, RAG systems, and automation-heavy workflows. We also support complex SaaS teams when AI reliability, workflow correctness, or subtle failure modes are the main risk.
If your product has a failure mode that's subtle, quiet, or hard to reproduce, that's the kind of work we take on.
Senior-led · AI-native · NDA-bound on every engagement
Qualura is a senior-led team of QA specialists activated per engagement. Every member has 4+ years of hands-on testing experience on enterprise-scale AI and SaaS products. AI copilots, collaboration platforms, search systems, productivity tools, and AI-powered notebooks used by millions of users globally.
Our team holds Lead Engineer-level specialists with backgrounds in global IT services programs. Every Qualura project is staffed by testers who've shipped at scale, not people learning on your product.
We can't name the products we've worked on. Every engagement, past and present, is NDA-bound. What we can say is that if you're building a modern AI assistant, agent, or copilot, someone on our team has already tested a product like it. And broken it in ways you'll want to know about before your users do.
Activated per engagement. Scaled to your scope. Held to your confidentiality.
Honesty is part of the service.
The questions most teams ask before Day 1.
AI products are our focus: LLM apps, AI agents, RAG systems, copilots, and AI-powered workflows. We also support complex SaaS when AI reliability, workflow correctness, or subtle product failure modes are the main risk.
Yes. The best time to run the Sprint is 2 to 4 weeks before a major release, so you have time to act on what we find. It also works as a pre-funding diligence exercise or as a baseline audit on a product already in production.
Then it was worth running the Sprint. You'll get a severity-ranked list and a clear remediation sequence. We'll tell you honestly whether the product is shippable, and if it isn't, what the minimum bar looks like.
No. The Sprint is deliberately audit-only. It keeps the engagement short, the scope tight, and our recommendations unconflicted. We hand your engineers everything they need to act quickly. For ongoing QA help beyond the Sprint, we run separate engagements.
Every bug ships with reproduction steps and evidence (logs, screenshots, network traces). For AI behavior findings, we include the exact prompts, model versions, and seeds where applicable, so your team can reproduce and verify independently.
Senior QA specialists only. Every member has 4+ years of hands-on experience, each owning a pillar: AI behavior, functional, UI/state, API/security, and accessibility/performance. No juniors billed as seniors.
Pricing depends on the engagement. Book a discovery call or email us with a short note about your product and what you're trying to validate. We'll reply with scope, timeline, and a quote.
Tell us about your product.
Book a 30-minute discovery call for an LLM product, AI agent, RAG system, or AI-powered workflow. If email is easier, send us a short note and we'll reply with next steps.
infas@qualura.com linkedin.com/company/qualura30-minute discovery call
What your product does, who uses it, and where reliability matters most.
Your launch timeline, release risk, and current testing coverage.
Whether a 5-Day AI Risk Audit Sprint or a custom QA engagement is the right fit.
Best for LLM products, AI agents, RAG systems, copilots, SaaS platforms, mobile apps, and automation-heavy workflows.