{
  "description": "Independent same-subject intent validation. Four different purposes for each identical sentence; no data used to select a weight.",
  "documents": [
    {
      "id": "api_secret:rotate",
      "family": "api_secret",
      "flavor": "rotate",
      "focus": "We need to handle this API key.",
      "context": "The integration credential appeared in a public build log. We need to handle this API key. Revoke the exposed value and issue a replacement before allowing further authenticated calls.",
      "noisy_context": "Another note concerned the weather forecast for a weekend outdoor gathering. The integration credential appeared in a public build log. We need to handle this API key. Revoke the exposed value and issue a replacement before allowing further authenticated calls. An unrelated note describes how to arrange photographs by the year they were taken. We also compared the lighting in a hallway with the lighting in a nearby classroom. Someone added a reminder about a walking route and the location of a public fountain. Separately, the team discussed a community garden and the date of its next volunteer meeting.",
      "split": "held_out"
    },
    {
      "id": "api_secret:scope",
      "family": "api_secret",
      "flavor": "scope",
      "focus": "We need to handle this API key.",
      "context": "The integration credential permits destructive actions that the reporting job never needs. We need to handle this API key. Reduce its allowed operations to the minimum read permissions necessary for the job.",
      "noisy_context": "There was also a discussion of a puzzle, its rules, and how long it took to finish. The integration credential permits destructive actions that the reporting job never needs. We need to handle this API key. Reduce its allowed operations to the minimum read permissions necessary for the job. A separate planning item lists the dates of a local exhibition and its opening reception. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. Someone added a reminder about a walking route and the location of a public fountain. Separately, the team discussed a community garden and the date of its next volunteer meeting.",
      "split": "held_out"
    },
    {
      "id": "api_secret:storage",
      "family": "api_secret",
      "flavor": "storage",
      "focus": "We need to handle this API key.",
      "context": "The integration credential is sitting in a repository configuration file. We need to handle this API key. Move the value into managed secret storage and keep it out of source control.",
      "noisy_context": "Another note concerned the weather forecast for a weekend outdoor gathering. The integration credential is sitting in a repository configuration file. We need to handle this API key. Move the value into managed secret storage and keep it out of source control. Separately, the team discussed a community garden and the date of its next volunteer meeting. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. Someone added a reminder about a walking route and the location of a public fountain. There was also a discussion of a puzzle, its rules, and how long it took to finish.",
      "split": "held_out"
    },
    {
      "id": "api_secret:audit",
      "family": "api_secret",
      "flavor": "audit",
      "focus": "We need to handle this API key.",
      "context": "The integration credential has unexpectedly high request activity. We need to handle this API key. Inspect its usage history and determine which caller is generating the unexplained traffic.",
      "noisy_context": "There was also a discussion of a puzzle, its rules, and how long it took to finish. The integration credential has unexpectedly high request activity. We need to handle this API key. Inspect its usage history and determine which caller is generating the unexplained traffic. We also compared the lighting in a hallway with the lighting in a nearby classroom. An unrelated note describes how to arrange photographs by the year they were taken. Someone added a reminder about a walking route and the location of a public fountain. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables.",
      "split": "held_out"
    },
    {
      "id": "conversation_archive:summary",
      "family": "conversation_archive",
      "flavor": "summary",
      "focus": "We need to handle this conversation.",
      "context": "A long discussion must be handed to a colleague who needs its decisions rather than every turn. We need to handle this conversation. Write a concise account of the conclusions, open questions, and agreed next actions.",
      "noisy_context": "Another note concerned the weather forecast for a weekend outdoor gathering. A long discussion must be handed to a colleague who needs its decisions rather than every turn. We need to handle this conversation. Write a concise account of the conclusions, open questions, and agreed next actions. Separately, the team discussed a community garden and the date of its next volunteer meeting. An unrelated note describes how to arrange photographs by the year they were taken. There was also a discussion of a puzzle, its rules, and how long it took to finish. We also compared the lighting in a hallway with the lighting in a nearby classroom.",
      "split": "held_out"
    },
    {
      "id": "conversation_archive:restore",
      "family": "conversation_archive",
      "flavor": "restore",
      "focus": "We need to handle this conversation.",
      "context": "The person accidentally archived an active discussion and cannot find it in the current list. We need to handle this conversation. Locate the existing transcript and restore it to the visible list without creating a duplicate.",
      "noisy_context": "Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. The person accidentally archived an active discussion and cannot find it in the current list. We need to handle this conversation. Locate the existing transcript and restore it to the visible list without creating a duplicate. A separate planning item lists the dates of a local exhibition and its opening reception. An unrelated note describes how to arrange photographs by the year they were taken. Another note concerned the weather forecast for a weekend outdoor gathering. There was also a discussion of a puzzle, its rules, and how long it took to finish.",
      "split": "held_out"
    },
    {
      "id": "conversation_archive:share",
      "family": "conversation_archive",
      "flavor": "share",
      "focus": "We need to handle this conversation.",
      "context": "A collaborator needs access to the discussion, which includes private contact details. We need to handle this conversation. Review sensitive content and grant access only to the authorized collaborator.",
      "noisy_context": "There was also a discussion of a puzzle, its rules, and how long it took to finish. A collaborator needs access to the discussion, which includes private contact details. We need to handle this conversation. Review sensitive content and grant access only to the authorized collaborator. An unrelated note describes how to arrange photographs by the year they were taken. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We also compared the lighting in a hallway with the lighting in a nearby classroom. Someone added a reminder about a walking route and the location of a public fountain.",
      "split": "held_out"
    },
    {
      "id": "conversation_archive:erase",
      "family": "conversation_archive",
      "flavor": "erase",
      "focus": "We need to handle this conversation.",
      "context": "The owner has explicitly requested permanent removal of the discussion and its retained data. We need to handle this conversation. Follow the deletion request and remove associated retained material under the applicable data policy.",
      "noisy_context": "A separate planning item lists the dates of a local exhibition and its opening reception. The owner has explicitly requested permanent removal of the discussion and its retained data. We need to handle this conversation. Follow the deletion request and remove associated retained material under the applicable data policy. There was also a discussion of a puzzle, its rules, and how long it took to finish. An unrelated note describes how to arrange photographs by the year they were taken. Someone added a reminder about a walking route and the location of a public fountain. Another note concerned the weather forecast for a weekend outdoor gathering.",
      "split": "held_out"
    },
    {
      "id": "classifier_ops:diagnose",
      "family": "classifier_ops",
      "flavor": "diagnose",
      "focus": "We need to handle this classifier.",
      "context": "Recent predictions are unreliable, but the team does not yet know whether inputs or labels changed. We need to handle this classifier. Compare feature distributions and error categories to identify the cause before changing the trained parameters.",
      "noisy_context": "There was also a discussion of a puzzle, its rules, and how long it took to finish. Recent predictions are unreliable, but the team does not yet know whether inputs or labels changed. We need to handle this classifier. Compare feature distributions and error categories to identify the cause before changing the trained parameters. Someone added a reminder about a walking route and the location of a public fountain. A separate planning item lists the dates of a local exhibition and its opening reception. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We also compared the lighting in a hallway with the lighting in a nearby classroom.",
      "split": "held_out"
    },
    {
      "id": "classifier_ops:retrain",
      "family": "classifier_ops",
      "flavor": "retrain",
      "focus": "We need to handle this classifier.",
      "context": "The team has confirmed a stable change in behavior and collected reviewed examples from the new population. We need to handle this classifier. Fit a new version on the approved examples and evaluate it before replacing the deployed version.",
      "noisy_context": "Another note concerned the weather forecast for a weekend outdoor gathering. The team has confirmed a stable change in behavior and collected reviewed examples from the new population. We need to handle this classifier. Fit a new version on the approved examples and evaluate it before replacing the deployed version. There was also a discussion of a puzzle, its rules, and how long it took to finish. An unrelated note describes how to arrange photographs by the year they were taken. A separate planning item lists the dates of a local exhibition and its opening reception. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables.",
      "split": "held_out"
    },
    {
      "id": "classifier_ops:monitor",
      "family": "classifier_ops",
      "flavor": "monitor",
      "focus": "We need to handle this classifier.",
      "context": "The deployed version is currently performing acceptably, but degradation must be detected promptly. We need to handle this classifier. Track relevant quality metrics and alert when validated thresholds are exceeded.",
      "noisy_context": "There was also a discussion of a puzzle, its rules, and how long it took to finish. The deployed version is currently performing acceptably, but degradation must be detected promptly. We need to handle this classifier. Track relevant quality metrics and alert when validated thresholds are exceeded. An unrelated note describes how to arrange photographs by the year they were taken. Someone added a reminder about a walking route and the location of a public fountain. A separate planning item lists the dates of a local exhibition and its opening reception. Another note concerned the weather forecast for a weekend outdoor gathering.",
      "split": "held_out"
    },
    {
      "id": "classifier_ops:rollback",
      "family": "classifier_ops",
      "flavor": "rollback",
      "focus": "We need to handle this classifier.",
      "context": "A newly deployed version performs worse than the previously validated release. We need to handle this classifier. Restore the earlier validated version while investigating the regression in the new deployment.",
      "noisy_context": "A separate planning item lists the dates of a local exhibition and its opening reception. A newly deployed version performs worse than the previously validated release. We need to handle this classifier. Restore the earlier validated version while investigating the regression in the new deployment. An unrelated note describes how to arrange photographs by the year they were taken. Separately, the team discussed a community garden and the date of its next volunteer meeting. We also compared the lighting in a hallway with the lighting in a nearby classroom. Someone added a reminder about a walking route and the location of a public fountain.",
      "split": "held_out"
    },
    {
      "id": "image_ops:compress",
      "family": "image_ops",
      "flavor": "compress",
      "focus": "We need to handle this image.",
      "context": "The visual file is too large for an upload limit, although its current dimensions are suitable. We need to handle this image. Reduce encoded file size while retaining acceptable visible quality and the existing layout.",
      "noisy_context": "Separately, the team discussed a community garden and the date of its next volunteer meeting. The visual file is too large for an upload limit, although its current dimensions are suitable. We need to handle this image. Reduce encoded file size while retaining acceptable visible quality and the existing layout. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. A separate planning item lists the dates of a local exhibition and its opening reception. We also compared the lighting in a hallway with the lighting in a nearby classroom. Another note concerned the weather forecast for a weekend outdoor gathering.",
      "split": "held_out"
    },
    {
      "id": "image_ops:resize",
      "family": "image_ops",
      "flavor": "resize",
      "focus": "We need to handle this image.",
      "context": "The visual file has the wrong dimensions for a vertical presentation surface. We need to handle this image. Adapt its aspect ratio and framing to the target surface without cropping away the subject.",
      "noisy_context": "An unrelated note describes how to arrange photographs by the year they were taken. The visual file has the wrong dimensions for a vertical presentation surface. We need to handle this image. Adapt its aspect ratio and framing to the target surface without cropping away the subject. There was also a discussion of a puzzle, its rules, and how long it took to finish. A separate planning item lists the dates of a local exhibition and its opening reception. Separately, the team discussed a community garden and the date of its next volunteer meeting. Another note concerned the weather forecast for a weekend outdoor gathering.",
      "split": "held_out"
    },
    {
      "id": "image_ops:redact",
      "family": "image_ops",
      "flavor": "redact",
      "focus": "We need to handle this image.",
      "context": "The visual file exposes a person's private address and identifying details. We need to handle this image. Remove the sensitive details before making the visual available to others.",
      "noisy_context": "Someone added a reminder about a walking route and the location of a public fountain. The visual file exposes a person's private address and identifying details. We need to handle this image. Remove the sensitive details before making the visual available to others. There was also a discussion of a puzzle, its rules, and how long it took to finish. Another note concerned the weather forecast for a weekend outdoor gathering. Separately, the team discussed a community garden and the date of its next volunteer meeting. A separate planning item lists the dates of a local exhibition and its opening reception.",
      "split": "held_out"
    },
    {
      "id": "image_ops:inspect",
      "family": "image_ops",
      "flavor": "inspect",
      "focus": "We need to handle this image.",
      "context": "The visual file may contain illegible labels or rendering defects. We need to handle this image. Inspect the actual output at usable scale and identify quality defects before approving it.",
      "noisy_context": "There was also a discussion of a puzzle, its rules, and how long it took to finish. The visual file may contain illegible labels or rendering defects. We need to handle this image. Inspect the actual output at usable scale and identify quality defects before approving it. A separate planning item lists the dates of a local exhibition and its opening reception. Separately, the team discussed a community garden and the date of its next volunteer meeting. Another note concerned the weather forecast for a weekend outdoor gathering. An unrelated note describes how to arrange photographs by the year they were taken.",
      "split": "held_out"
    },
    {
      "id": "customer_entry:recover",
      "family": "customer_entry",
      "flavor": "recover",
      "focus": "We need to handle this customer record.",
      "context": "A customer entry disappeared after an import, and a verified backup contains its earlier values. We need to handle this customer record. Recover the entry from the verified backup and preserve evidence of the import failure.",
      "noisy_context": "Someone added a reminder about a walking route and the location of a public fountain. A customer entry disappeared after an import, and a verified backup contains its earlier values. We need to handle this customer record. Recover the entry from the verified backup and preserve evidence of the import failure. We also compared the lighting in a hallway with the lighting in a nearby classroom. An unrelated note describes how to arrange photographs by the year they were taken. Another note concerned the weather forecast for a weekend outdoor gathering. A separate planning item lists the dates of a local exhibition and its opening reception.",
      "split": "held_out"
    },
    {
      "id": "customer_entry:correct",
      "family": "customer_entry",
      "flavor": "correct",
      "focus": "We need to handle this customer record.",
      "context": "A visible customer entry has an outdated contact address supplied by the owner. We need to handle this customer record. Apply the owner's confirmed replacement and retain an audit trail of the correction.",
      "noisy_context": "Separately, the team discussed a community garden and the date of its next volunteer meeting. A visible customer entry has an outdated contact address supplied by the owner. We need to handle this customer record. Apply the owner's confirmed replacement and retain an audit trail of the correction. An unrelated note describes how to arrange photographs by the year they were taken. There was also a discussion of a puzzle, its rules, and how long it took to finish. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. Someone added a reminder about a walking route and the location of a public fountain.",
      "split": "held_out"
    },
    {
      "id": "customer_entry:export",
      "family": "customer_entry",
      "flavor": "export",
      "focus": "We need to handle this customer record.",
      "context": "A customer has requested a portable copy of the information held about them. We need to handle this customer record. Verify the requester's identity and deliver their authorized data in the agreed export format.",
      "noisy_context": "Separately, the team discussed a community garden and the date of its next volunteer meeting. A customer has requested a portable copy of the information held about them. We need to handle this customer record. Verify the requester's identity and deliver their authorized data in the agreed export format. A separate planning item lists the dates of a local exhibition and its opening reception. There was also a discussion of a puzzle, its rules, and how long it took to finish. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. An unrelated note describes how to arrange photographs by the year they were taken.",
      "split": "held_out"
    },
    {
      "id": "customer_entry:restrict",
      "family": "customer_entry",
      "flavor": "restrict",
      "focus": "We need to handle this customer record.",
      "context": "An internal role can see more of a customer entry than its assigned task requires. We need to handle this customer record. Remove unnecessary access and limit visible fields to the role's legitimate task.",
      "noisy_context": "Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. An internal role can see more of a customer entry than its assigned task requires. We need to handle this customer record. Remove unnecessary access and limit visible fields to the role's legitimate task. An unrelated note describes how to arrange photographs by the year they were taken. We also compared the lighting in a hallway with the lighting in a nearby classroom. Someone added a reminder about a walking route and the location of a public fountain. There was also a discussion of a puzzle, its rules, and how long it took to finish.",
      "split": "held_out"
    },
    {
      "id": "notification_ops:schedule",
      "family": "notification_ops",
      "flavor": "schedule",
      "focus": "We need to handle this notification.",
      "context": "An alert is useful but arrives during the recipient's quiet hours. We need to handle this notification. Defer delivery to the approved time window while preserving the underlying event.",
      "noisy_context": "Someone added a reminder about a walking route and the location of a public fountain. An alert is useful but arrives during the recipient's quiet hours. We need to handle this notification. Defer delivery to the approved time window while preserving the underlying event. An unrelated note describes how to arrange photographs by the year they were taken. We also compared the lighting in a hallway with the lighting in a nearby classroom. There was also a discussion of a puzzle, its rules, and how long it took to finish. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables.",
      "split": "held_out"
    },
    {
      "id": "notification_ops:route",
      "family": "notification_ops",
      "flavor": "route",
      "focus": "We need to handle this notification.",
      "context": "An alert about an unresolved task currently reaches someone who cannot act on it. We need to handle this notification. Deliver it to the responsible owner rather than broadcasting to unrelated people.",
      "noisy_context": "A separate planning item lists the dates of a local exhibition and its opening reception. An alert about an unresolved task currently reaches someone who cannot act on it. We need to handle this notification. Deliver it to the responsible owner rather than broadcasting to unrelated people. An unrelated note describes how to arrange photographs by the year they were taken. Another note concerned the weather forecast for a weekend outdoor gathering. There was also a discussion of a puzzle, its rules, and how long it took to finish. We also compared the lighting in a hallway with the lighting in a nearby classroom.",
      "split": "held_out"
    },
    {
      "id": "notification_ops:deduplicate",
      "family": "notification_ops",
      "flavor": "deduplicate",
      "focus": "We need to handle this notification.",
      "context": "The same event generates repeated alerts that add no new information. We need to handle this notification. Collapse repeated copies into one actionable message and retain the event identity.",
      "noisy_context": "Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. The same event generates repeated alerts that add no new information. We need to handle this notification. Collapse repeated copies into one actionable message and retain the event identity. Another note concerned the weather forecast for a weekend outdoor gathering. There was also a discussion of a puzzle, its rules, and how long it took to finish. A separate planning item lists the dates of a local exhibition and its opening reception. Separately, the team discussed a community garden and the date of its next volunteer meeting.",
      "split": "held_out"
    },
    {
      "id": "notification_ops:acknowledge",
      "family": "notification_ops",
      "flavor": "acknowledge",
      "focus": "We need to handle this notification.",
      "context": "An alert was delivered, but the workflow must confirm that its owner has seen it. We need to handle this notification. Record an explicit acknowledgment without pretending that receipt alone means the task is complete.",
      "noisy_context": "We also compared the lighting in a hallway with the lighting in a nearby classroom. An alert was delivered, but the workflow must confirm that its owner has seen it. We need to handle this notification. Record an explicit acknowledgment without pretending that receipt alone means the task is complete. Separately, the team discussed a community garden and the date of its next volunteer meeting. An unrelated note describes how to arrange photographs by the year they were taken. A separate planning item lists the dates of a local exhibition and its opening reception. Someone added a reminder about a walking route and the location of a public fountain.",
      "split": "held_out"
    },
    {
      "id": "browser_ops:resume",
      "family": "browser_ops",
      "flavor": "resume",
      "focus": "We need to handle this browser session.",
      "context": "A page interaction was interrupted, but the existing browser state remains available. We need to handle this browser session. Reconnect to the same state and continue the unfinished interaction without resetting it.",
      "noisy_context": "An unrelated note describes how to arrange photographs by the year they were taken. A page interaction was interrupted, but the existing browser state remains available. We need to handle this browser session. Reconnect to the same state and continue the unfinished interaction without resetting it. Another note concerned the weather forecast for a weekend outdoor gathering. Separately, the team discussed a community garden and the date of its next volunteer meeting. Someone added a reminder about a walking route and the location of a public fountain. A separate planning item lists the dates of a local exhibition and its opening reception.",
      "split": "held_out"
    },
    {
      "id": "browser_ops:isolate",
      "family": "browser_ops",
      "flavor": "isolate",
      "focus": "We need to handle this browser session.",
      "context": "Two different users must use an application without sharing authentication state. We need to handle this browser session. Provide separate cookie stores and browsing contexts so one person's credentials never reach the other.",
      "noisy_context": "There was also a discussion of a puzzle, its rules, and how long it took to finish. Two different users must use an application without sharing authentication state. We need to handle this browser session. Provide separate cookie stores and browsing contexts so one person's credentials never reach the other. We also compared the lighting in a hallway with the lighting in a nearby classroom. Separately, the team discussed a community garden and the date of its next volunteer meeting. Someone added a reminder about a walking route and the location of a public fountain. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables.",
      "split": "held_out"
    },
    {
      "id": "browser_ops:diagnose",
      "family": "browser_ops",
      "flavor": "diagnose",
      "focus": "We need to handle this browser session.",
      "context": "A page action fails intermittently, and the team needs evidence of the failure. We need to handle this browser session. Capture relevant console and request traces around the failed interaction before retrying.",
      "noisy_context": "There was also a discussion of a puzzle, its rules, and how long it took to finish. A page action fails intermittently, and the team needs evidence of the failure. We need to handle this browser session. Capture relevant console and request traces around the failed interaction before retrying. Someone added a reminder about a walking route and the location of a public fountain. We also compared the lighting in a hallway with the lighting in a nearby classroom. An unrelated note describes how to arrange photographs by the year they were taken. A separate planning item lists the dates of a local exhibition and its opening reception.",
      "split": "held_out"
    },
    {
      "id": "browser_ops:revoke",
      "family": "browser_ops",
      "flavor": "revoke",
      "focus": "We need to handle this browser session.",
      "context": "A signed-in device was lost and must no longer retain access to the application. We need to handle this browser session. Invalidate its authentication state so the lost device cannot continue operating as the owner.",
      "noisy_context": "There was also a discussion of a puzzle, its rules, and how long it took to finish. A signed-in device was lost and must no longer retain access to the application. We need to handle this browser session. Invalidate its authentication state so the lost device cannot continue operating as the owner. Someone added a reminder about a walking route and the location of a public fountain. An unrelated note describes how to arrange photographs by the year they were taken. We also compared the lighting in a hallway with the lighting in a nearby classroom. Another note concerned the weather forecast for a weekend outdoor gathering.",
      "split": "held_out"
    },
    {
      "id": "email_ops:hold",
      "family": "email_ops",
      "flavor": "hold",
      "focus": "We need to handle this email.",
      "context": "A reply is written, but its owner has not approved delivery. We need to handle this email. Preserve the unsent draft and wait for explicit approval before sending.",
      "noisy_context": "We also compared the lighting in a hallway with the lighting in a nearby classroom. A reply is written, but its owner has not approved delivery. We need to handle this email. Preserve the unsent draft and wait for explicit approval before sending. There was also a discussion of a puzzle, its rules, and how long it took to finish. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. An unrelated note describes how to arrange photographs by the year they were taken. Separately, the team discussed a community garden and the date of its next volunteer meeting.",
      "split": "held_out"
    },
    {
      "id": "email_ops:deliver",
      "family": "email_ops",
      "flavor": "deliver",
      "focus": "We need to handle this email.",
      "context": "The owner reviewed the final reply and explicitly authorized its delivery to the confirmed recipient. We need to handle this email. Send the approved wording to the verified recipient and report the actual outcome.",
      "noisy_context": "A separate planning item lists the dates of a local exhibition and its opening reception. The owner reviewed the final reply and explicitly authorized its delivery to the confirmed recipient. We need to handle this email. Send the approved wording to the verified recipient and report the actual outcome. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We also compared the lighting in a hallway with the lighting in a nearby classroom. Separately, the team discussed a community garden and the date of its next volunteer meeting. An unrelated note describes how to arrange photographs by the year they were taken.",
      "split": "held_out"
    },
    {
      "id": "email_ops:recipient",
      "family": "email_ops",
      "flavor": "recipient",
      "focus": "We need to handle this email.",
      "context": "A prepared reply is addressed to someone whose identity has not been confirmed. We need to handle this email. Verify the intended person and destination before any delivery occurs.",
      "noisy_context": "A separate planning item lists the dates of a local exhibition and its opening reception. A prepared reply is addressed to someone whose identity has not been confirmed. We need to handle this email. Verify the intended person and destination before any delivery occurs. Separately, the team discussed a community garden and the date of its next volunteer meeting. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. Someone added a reminder about a walking route and the location of a public fountain. There was also a discussion of a puzzle, its rules, and how long it took to finish.",
      "split": "held_out"
    },
    {
      "id": "email_ops:tracking",
      "family": "email_ops",
      "flavor": "tracking",
      "focus": "We need to handle this email.",
      "context": "An approved outbound message contains a link whose campaign attribution is missing. We need to handle this email. Attach the correct attribution parameters to the link without changing the approved message meaning.",
      "noisy_context": "Separately, the team discussed a community garden and the date of its next volunteer meeting. An approved outbound message contains a link whose campaign attribution is missing. We need to handle this email. Attach the correct attribution parameters to the link without changing the approved message meaning. Someone added a reminder about a walking route and the location of a public fountain. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. Another note concerned the weather forecast for a weekend outdoor gathering. We also compared the lighting in a hallway with the lighting in a nearby classroom.",
      "split": "held_out"
    }
  ],
  "queries": [
    {
      "id": "api_secret:rotate:q1",
      "target": "api_secret:rotate",
      "family": "api_secret",
      "flavor": "rotate",
      "focus": "We need to handle this API key.",
      "text": "We need to handle this API key. A public build output exposed the integration secret; invalidate it and issue another.",
      "noisy_text": "We also compared the lighting in a hallway with the lighting in a nearby classroom. An unrelated note describes how to arrange photographs by the year they were taken. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We need to handle this API key. A public build output exposed the integration secret; invalidate it and issue another. There was also a discussion of a puzzle, its rules, and how long it took to finish. Another note concerned the weather forecast for a weekend outdoor gathering.",
      "split": "held_out"
    },
    {
      "id": "api_secret:rotate:q2",
      "target": "api_secret:rotate",
      "family": "api_secret",
      "flavor": "rotate",
      "focus": "We need to handle this API key.",
      "text": "We need to handle this API key. Someone leaked the service credential, so existing authenticated access must be replaced.",
      "noisy_text": "We also compared the lighting in a hallway with the lighting in a nearby classroom. Another note concerned the weather forecast for a weekend outdoor gathering. There was also a discussion of a puzzle, its rules, and how long it took to finish. We need to handle this API key. Someone leaked the service credential, so existing authenticated access must be replaced. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. Separately, the team discussed a community garden and the date of its next volunteer meeting.",
      "split": "held_out"
    },
    {
      "id": "api_secret:scope:q1",
      "target": "api_secret:scope",
      "family": "api_secret",
      "flavor": "scope",
      "focus": "We need to handle this API key.",
      "text": "We need to handle this API key. The reporting credential can delete data even though the task only reads it.",
      "noisy_text": "Separately, the team discussed a community garden and the date of its next volunteer meeting. Someone added a reminder about a walking route and the location of a public fountain. Another note concerned the weather forecast for a weekend outdoor gathering. We need to handle this API key. The reporting credential can delete data even though the task only reads it. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. A separate planning item lists the dates of a local exhibition and its opening reception.",
      "split": "held_out"
    },
    {
      "id": "api_secret:scope:q2",
      "target": "api_secret:scope",
      "family": "api_secret",
      "flavor": "scope",
      "focus": "We need to handle this API key.",
      "text": "We need to handle this API key. Narrow the service secret's privileges without changing the reporting workflow.",
      "noisy_text": "Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. There was also a discussion of a puzzle, its rules, and how long it took to finish. Someone added a reminder about a walking route and the location of a public fountain. We need to handle this API key. Narrow the service secret's privileges without changing the reporting workflow. Another note concerned the weather forecast for a weekend outdoor gathering. We also compared the lighting in a hallway with the lighting in a nearby classroom.",
      "split": "held_out"
    },
    {
      "id": "api_secret:storage:q1",
      "target": "api_secret:storage",
      "family": "api_secret",
      "flavor": "storage",
      "focus": "We need to handle this API key.",
      "text": "We need to handle this API key. Move the service credential out of tracked configuration into a secrets manager.",
      "noisy_text": "Someone added a reminder about a walking route and the location of a public fountain. Another note concerned the weather forecast for a weekend outdoor gathering. We also compared the lighting in a hallway with the lighting in a nearby classroom. We need to handle this API key. Move the service credential out of tracked configuration into a secrets manager. A separate planning item lists the dates of a local exhibition and its opening reception. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables.",
      "split": "held_out"
    },
    {
      "id": "api_secret:storage:q2",
      "target": "api_secret:storage",
      "family": "api_secret",
      "flavor": "storage",
      "focus": "We need to handle this API key.",
      "text": "We need to handle this API key. The integration secret must be stored outside the repository.",
      "noisy_text": "We also compared the lighting in a hallway with the lighting in a nearby classroom. A separate planning item lists the dates of a local exhibition and its opening reception. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We need to handle this API key. The integration secret must be stored outside the repository. An unrelated note describes how to arrange photographs by the year they were taken. Separately, the team discussed a community garden and the date of its next volunteer meeting.",
      "split": "held_out"
    },
    {
      "id": "api_secret:audit:q1",
      "target": "api_secret:audit",
      "family": "api_secret",
      "flavor": "audit",
      "focus": "We need to handle this API key.",
      "text": "We need to handle this API key. Find which caller is responsible for the unexplained requests made with this credential.",
      "noisy_text": "Another note concerned the weather forecast for a weekend outdoor gathering. A separate planning item lists the dates of a local exhibition and its opening reception. Someone added a reminder about a walking route and the location of a public fountain. We need to handle this API key. Find which caller is responsible for the unexplained requests made with this credential. Separately, the team discussed a community garden and the date of its next volunteer meeting. We also compared the lighting in a hallway with the lighting in a nearby classroom.",
      "split": "held_out"
    },
    {
      "id": "api_secret:audit:q2",
      "target": "api_secret:audit",
      "family": "api_secret",
      "flavor": "audit",
      "focus": "We need to handle this API key.",
      "text": "We need to handle this API key. Inspect the service secret's usage history to explain the sudden traffic increase.",
      "noisy_text": "There was also a discussion of a puzzle, its rules, and how long it took to finish. A separate planning item lists the dates of a local exhibition and its opening reception. Another note concerned the weather forecast for a weekend outdoor gathering. We need to handle this API key. Inspect the service secret's usage history to explain the sudden traffic increase. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. Someone added a reminder about a walking route and the location of a public fountain.",
      "split": "held_out"
    },
    {
      "id": "conversation_archive:summary:q1",
      "target": "conversation_archive:summary",
      "family": "conversation_archive",
      "flavor": "summary",
      "focus": "We need to handle this conversation.",
      "text": "We need to handle this conversation. Give the colleague the decisions and unresolved work from this long discussion.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. Separately, the team discussed a community garden and the date of its next volunteer meeting. Someone added a reminder about a walking route and the location of a public fountain. We need to handle this conversation. Give the colleague the decisions and unresolved work from this long discussion. We also compared the lighting in a hallway with the lighting in a nearby classroom. There was also a discussion of a puzzle, its rules, and how long it took to finish.",
      "split": "held_out"
    },
    {
      "id": "conversation_archive:summary:q2",
      "target": "conversation_archive:summary",
      "family": "conversation_archive",
      "flavor": "summary",
      "focus": "We need to handle this conversation.",
      "text": "We need to handle this conversation. Prepare a concise handoff of outcomes rather than forwarding every message.",
      "noisy_text": "We also compared the lighting in a hallway with the lighting in a nearby classroom. There was also a discussion of a puzzle, its rules, and how long it took to finish. An unrelated note describes how to arrange photographs by the year they were taken. We need to handle this conversation. Prepare a concise handoff of outcomes rather than forwarding every message. A separate planning item lists the dates of a local exhibition and its opening reception. Someone added a reminder about a walking route and the location of a public fountain.",
      "split": "held_out"
    },
    {
      "id": "conversation_archive:restore:q1",
      "target": "conversation_archive:restore",
      "family": "conversation_archive",
      "flavor": "restore",
      "focus": "We need to handle this conversation.",
      "text": "We need to handle this conversation. Bring the accidentally archived discussion back into the active list.",
      "noisy_text": "Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. There was also a discussion of a puzzle, its rules, and how long it took to finish. A separate planning item lists the dates of a local exhibition and its opening reception. We need to handle this conversation. Bring the accidentally archived discussion back into the active list. An unrelated note describes how to arrange photographs by the year they were taken. Someone added a reminder about a walking route and the location of a public fountain.",
      "split": "held_out"
    },
    {
      "id": "conversation_archive:restore:q2",
      "target": "conversation_archive:restore",
      "family": "conversation_archive",
      "flavor": "restore",
      "focus": "We need to handle this conversation.",
      "text": "We need to handle this conversation. Restore visibility of the existing transcript instead of starting a copy.",
      "noisy_text": "Separately, the team discussed a community garden and the date of its next volunteer meeting. A separate planning item lists the dates of a local exhibition and its opening reception. There was also a discussion of a puzzle, its rules, and how long it took to finish. We need to handle this conversation. Restore visibility of the existing transcript instead of starting a copy. An unrelated note describes how to arrange photographs by the year they were taken. Another note concerned the weather forecast for a weekend outdoor gathering.",
      "split": "held_out"
    },
    {
      "id": "conversation_archive:share:q1",
      "target": "conversation_archive:share",
      "family": "conversation_archive",
      "flavor": "share",
      "focus": "We need to handle this conversation.",
      "text": "We need to handle this conversation. Check private details before giving the authorized collaborator access to this discussion.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. An unrelated note describes how to arrange photographs by the year they were taken. Another note concerned the weather forecast for a weekend outdoor gathering. We need to handle this conversation. Check private details before giving the authorized collaborator access to this discussion. We also compared the lighting in a hallway with the lighting in a nearby classroom. There was also a discussion of a puzzle, its rules, and how long it took to finish.",
      "split": "held_out"
    },
    {
      "id": "conversation_archive:share:q2",
      "target": "conversation_archive:share",
      "family": "conversation_archive",
      "flavor": "share",
      "focus": "We need to handle this conversation.",
      "text": "We need to handle this conversation. We must review sensitive messages before sharing the transcript with a teammate.",
      "noisy_text": "There was also a discussion of a puzzle, its rules, and how long it took to finish. We also compared the lighting in a hallway with the lighting in a nearby classroom. Another note concerned the weather forecast for a weekend outdoor gathering. We need to handle this conversation. We must review sensitive messages before sharing the transcript with a teammate. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. A separate planning item lists the dates of a local exhibition and its opening reception.",
      "split": "held_out"
    },
    {
      "id": "conversation_archive:erase:q1",
      "target": "conversation_archive:erase",
      "family": "conversation_archive",
      "flavor": "erase",
      "focus": "We need to handle this conversation.",
      "text": "We need to handle this conversation. The owner wants this transcript and its retained material permanently removed.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. Separately, the team discussed a community garden and the date of its next volunteer meeting. We also compared the lighting in a hallway with the lighting in a nearby classroom. We need to handle this conversation. The owner wants this transcript and its retained material permanently removed. An unrelated note describes how to arrange photographs by the year they were taken. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables.",
      "split": "held_out"
    },
    {
      "id": "conversation_archive:erase:q2",
      "target": "conversation_archive:erase",
      "family": "conversation_archive",
      "flavor": "erase",
      "focus": "We need to handle this conversation.",
      "text": "We need to handle this conversation. Carry out the requested erasure of the discussion and related stored data.",
      "noisy_text": "Another note concerned the weather forecast for a weekend outdoor gathering. An unrelated note describes how to arrange photographs by the year they were taken. There was also a discussion of a puzzle, its rules, and how long it took to finish. We need to handle this conversation. Carry out the requested erasure of the discussion and related stored data. We also compared the lighting in a hallway with the lighting in a nearby classroom. Separately, the team discussed a community garden and the date of its next volunteer meeting.",
      "split": "held_out"
    },
    {
      "id": "classifier_ops:diagnose:q1",
      "target": "classifier_ops:diagnose",
      "family": "classifier_ops",
      "flavor": "diagnose",
      "focus": "We need to handle this classifier.",
      "text": "We need to handle this classifier. Investigate whether shifted inputs or changed labels explain the unreliable predictions.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. There was also a discussion of a puzzle, its rules, and how long it took to finish. We need to handle this classifier. Investigate whether shifted inputs or changed labels explain the unreliable predictions. An unrelated note describes how to arrange photographs by the year they were taken. Another note concerned the weather forecast for a weekend outdoor gathering.",
      "split": "held_out"
    },
    {
      "id": "classifier_ops:diagnose:q2",
      "target": "classifier_ops:diagnose",
      "family": "classifier_ops",
      "flavor": "diagnose",
      "focus": "We need to handle this classifier.",
      "text": "We need to handle this classifier. Find the source of the new prediction errors before modifying the trained parameters.",
      "noisy_text": "There was also a discussion of a puzzle, its rules, and how long it took to finish. An unrelated note describes how to arrange photographs by the year they were taken. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We need to handle this classifier. Find the source of the new prediction errors before modifying the trained parameters. A separate planning item lists the dates of a local exhibition and its opening reception. Someone added a reminder about a walking route and the location of a public fountain.",
      "split": "held_out"
    },
    {
      "id": "classifier_ops:retrain:q1",
      "target": "classifier_ops:retrain",
      "family": "classifier_ops",
      "flavor": "retrain",
      "focus": "We need to handle this classifier.",
      "text": "We need to handle this classifier. Train a replacement using the reviewed examples from the changed population.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. Separately, the team discussed a community garden and the date of its next volunteer meeting. Someone added a reminder about a walking route and the location of a public fountain. We need to handle this classifier. Train a replacement using the reviewed examples from the changed population. Another note concerned the weather forecast for a weekend outdoor gathering. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables.",
      "split": "held_out"
    },
    {
      "id": "classifier_ops:retrain:q2",
      "target": "classifier_ops:retrain",
      "family": "classifier_ops",
      "flavor": "retrain",
      "focus": "We need to handle this classifier.",
      "text": "We need to handle this classifier. Fit and evaluate a new version now that the behavioral shift is confirmed.",
      "noisy_text": "There was also a discussion of a puzzle, its rules, and how long it took to finish. Someone added a reminder about a walking route and the location of a public fountain. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We need to handle this classifier. Fit and evaluate a new version now that the behavioral shift is confirmed. Another note concerned the weather forecast for a weekend outdoor gathering. An unrelated note describes how to arrange photographs by the year they were taken.",
      "split": "held_out"
    },
    {
      "id": "classifier_ops:monitor:q1",
      "target": "classifier_ops:monitor",
      "family": "classifier_ops",
      "flavor": "monitor",
      "focus": "We need to handle this classifier.",
      "text": "We need to handle this classifier. Set up quality alerts for future degradation of the currently healthy deployed predictor.",
      "noisy_text": "Someone added a reminder about a walking route and the location of a public fountain. An unrelated note describes how to arrange photographs by the year they were taken. Separately, the team discussed a community garden and the date of its next volunteer meeting. We need to handle this classifier. Set up quality alerts for future degradation of the currently healthy deployed predictor. We also compared the lighting in a hallway with the lighting in a nearby classroom. There was also a discussion of a puzzle, its rules, and how long it took to finish.",
      "split": "held_out"
    },
    {
      "id": "classifier_ops:monitor:q2",
      "target": "classifier_ops:monitor",
      "family": "classifier_ops",
      "flavor": "monitor",
      "focus": "We need to handle this classifier.",
      "text": "We need to handle this classifier. Monitor performance and notify the team if the accepted quality thresholds are crossed.",
      "noisy_text": "Separately, the team discussed a community garden and the date of its next volunteer meeting. An unrelated note describes how to arrange photographs by the year they were taken. Someone added a reminder about a walking route and the location of a public fountain. We need to handle this classifier. Monitor performance and notify the team if the accepted quality thresholds are crossed. There was also a discussion of a puzzle, its rules, and how long it took to finish. A separate planning item lists the dates of a local exhibition and its opening reception.",
      "split": "held_out"
    },
    {
      "id": "classifier_ops:rollback:q1",
      "target": "classifier_ops:rollback",
      "family": "classifier_ops",
      "flavor": "rollback",
      "focus": "We need to handle this classifier.",
      "text": "We need to handle this classifier. Restore the old validated predictor after the new release degraded quality.",
      "noisy_text": "There was also a discussion of a puzzle, its rules, and how long it took to finish. Someone added a reminder about a walking route and the location of a public fountain. Separately, the team discussed a community garden and the date of its next volunteer meeting. We need to handle this classifier. Restore the old validated predictor after the new release degraded quality. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We also compared the lighting in a hallway with the lighting in a nearby classroom.",
      "split": "held_out"
    },
    {
      "id": "classifier_ops:rollback:q2",
      "target": "classifier_ops:rollback",
      "family": "classifier_ops",
      "flavor": "rollback",
      "focus": "We need to handle this classifier.",
      "text": "We need to handle this classifier. Revert the recent deployment and investigate its regression separately.",
      "noisy_text": "Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. An unrelated note describes how to arrange photographs by the year they were taken. Someone added a reminder about a walking route and the location of a public fountain. We need to handle this classifier. Revert the recent deployment and investigate its regression separately. There was also a discussion of a puzzle, its rules, and how long it took to finish. Another note concerned the weather forecast for a weekend outdoor gathering.",
      "split": "held_out"
    },
    {
      "id": "image_ops:compress:q1",
      "target": "image_ops:compress",
      "family": "image_ops",
      "flavor": "compress",
      "focus": "We need to handle this image.",
      "text": "We need to handle this image. Reduce the upload size while preserving the existing pixel dimensions.",
      "noisy_text": "Another note concerned the weather forecast for a weekend outdoor gathering. Separately, the team discussed a community garden and the date of its next volunteer meeting. Someone added a reminder about a walking route and the location of a public fountain. We need to handle this image. Reduce the upload size while preserving the existing pixel dimensions. An unrelated note describes how to arrange photographs by the year they were taken. There was also a discussion of a puzzle, its rules, and how long it took to finish.",
      "split": "held_out"
    },
    {
      "id": "image_ops:compress:q2",
      "target": "image_ops:compress",
      "family": "image_ops",
      "flavor": "compress",
      "focus": "We need to handle this image.",
      "text": "We need to handle this image. The file exceeds the upload limit; make its encoding smaller without changing the layout.",
      "noisy_text": "Separately, the team discussed a community garden and the date of its next volunteer meeting. There was also a discussion of a puzzle, its rules, and how long it took to finish. An unrelated note describes how to arrange photographs by the year they were taken. We need to handle this image. The file exceeds the upload limit; make its encoding smaller without changing the layout. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We also compared the lighting in a hallway with the lighting in a nearby classroom.",
      "split": "held_out"
    },
    {
      "id": "image_ops:resize:q1",
      "target": "image_ops:resize",
      "family": "image_ops",
      "flavor": "resize",
      "focus": "We need to handle this image.",
      "text": "We need to handle this image. Fit the visual to a vertical canvas while keeping the subject in frame.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. We also compared the lighting in a hallway with the lighting in a nearby classroom. Separately, the team discussed a community garden and the date of its next volunteer meeting. We need to handle this image. Fit the visual to a vertical canvas while keeping the subject in frame. Someone added a reminder about a walking route and the location of a public fountain. Another note concerned the weather forecast for a weekend outdoor gathering.",
      "split": "held_out"
    },
    {
      "id": "image_ops:resize:q2",
      "target": "image_ops:resize",
      "family": "image_ops",
      "flavor": "resize",
      "focus": "We need to handle this image.",
      "text": "We need to handle this image. Change the dimensions and composition to match the portrait presentation surface.",
      "noisy_text": "Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. Someone added a reminder about a walking route and the location of a public fountain. A separate planning item lists the dates of a local exhibition and its opening reception. We need to handle this image. Change the dimensions and composition to match the portrait presentation surface. Another note concerned the weather forecast for a weekend outdoor gathering. Separately, the team discussed a community garden and the date of its next volunteer meeting.",
      "split": "held_out"
    },
    {
      "id": "image_ops:redact:q1",
      "target": "image_ops:redact",
      "family": "image_ops",
      "flavor": "redact",
      "focus": "We need to handle this image.",
      "text": "We need to handle this image. Hide the private address and identifying information before sharing the visual.",
      "noisy_text": "We also compared the lighting in a hallway with the lighting in a nearby classroom. An unrelated note describes how to arrange photographs by the year they were taken. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We need to handle this image. Hide the private address and identifying information before sharing the visual. A separate planning item lists the dates of a local exhibition and its opening reception. Someone added a reminder about a walking route and the location of a public fountain.",
      "split": "held_out"
    },
    {
      "id": "image_ops:redact:q2",
      "target": "image_ops:redact",
      "family": "image_ops",
      "flavor": "redact",
      "focus": "We need to handle this image.",
      "text": "We need to handle this image. Remove personal details visible in the picture before it reaches other people.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. Someone added a reminder about a walking route and the location of a public fountain. Another note concerned the weather forecast for a weekend outdoor gathering. We need to handle this image. Remove personal details visible in the picture before it reaches other people. We also compared the lighting in a hallway with the lighting in a nearby classroom. Separately, the team discussed a community garden and the date of its next volunteer meeting.",
      "split": "held_out"
    },
    {
      "id": "image_ops:inspect:q1",
      "target": "image_ops:inspect",
      "family": "image_ops",
      "flavor": "inspect",
      "focus": "We need to handle this image.",
      "text": "We need to handle this image. Check the actual rendered visual for unreadable labels before approval.",
      "noisy_text": "Someone added a reminder about a walking route and the location of a public fountain. Another note concerned the weather forecast for a weekend outdoor gathering. An unrelated note describes how to arrange photographs by the year they were taken. We need to handle this image. Check the actual rendered visual for unreadable labels before approval. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. There was also a discussion of a puzzle, its rules, and how long it took to finish.",
      "split": "held_out"
    },
    {
      "id": "image_ops:inspect:q2",
      "target": "image_ops:inspect",
      "family": "image_ops",
      "flavor": "inspect",
      "focus": "We need to handle this image.",
      "text": "We need to handle this image. Examine the finished output to find rendering defects rather than trusting generation success.",
      "noisy_text": "An unrelated note describes how to arrange photographs by the year they were taken. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We also compared the lighting in a hallway with the lighting in a nearby classroom. We need to handle this image. Examine the finished output to find rendering defects rather than trusting generation success. A separate planning item lists the dates of a local exhibition and its opening reception. Another note concerned the weather forecast for a weekend outdoor gathering.",
      "split": "held_out"
    },
    {
      "id": "customer_entry:recover:q1",
      "target": "customer_entry:recover",
      "family": "customer_entry",
      "flavor": "recover",
      "focus": "We need to handle this customer record.",
      "text": "We need to handle this customer record. Restore the customer entry that disappeared during import using the verified backup.",
      "noisy_text": "Separately, the team discussed a community garden and the date of its next volunteer meeting. There was also a discussion of a puzzle, its rules, and how long it took to finish. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We need to handle this customer record. Restore the customer entry that disappeared during import using the verified backup. A separate planning item lists the dates of a local exhibition and its opening reception. We also compared the lighting in a hallway with the lighting in a nearby classroom.",
      "split": "held_out"
    },
    {
      "id": "customer_entry:recover:q2",
      "target": "customer_entry:recover",
      "family": "customer_entry",
      "flavor": "recover",
      "focus": "We need to handle this customer record.",
      "text": "We need to handle this customer record. Recover this missing entry and retain evidence about the failed import.",
      "noisy_text": "Someone added a reminder about a walking route and the location of a public fountain. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We also compared the lighting in a hallway with the lighting in a nearby classroom. We need to handle this customer record. Recover this missing entry and retain evidence about the failed import. Another note concerned the weather forecast for a weekend outdoor gathering. There was also a discussion of a puzzle, its rules, and how long it took to finish.",
      "split": "held_out"
    },
    {
      "id": "customer_entry:correct:q1",
      "target": "customer_entry:correct",
      "family": "customer_entry",
      "flavor": "correct",
      "focus": "We need to handle this customer record.",
      "text": "We need to handle this customer record. Replace the stale contact address with the owner's confirmed correction.",
      "noisy_text": "There was also a discussion of a puzzle, its rules, and how long it took to finish. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. An unrelated note describes how to arrange photographs by the year they were taken. We need to handle this customer record. Replace the stale contact address with the owner's confirmed correction. Someone added a reminder about a walking route and the location of a public fountain. We also compared the lighting in a hallway with the lighting in a nearby classroom.",
      "split": "held_out"
    },
    {
      "id": "customer_entry:correct:q2",
      "target": "customer_entry:correct",
      "family": "customer_entry",
      "flavor": "correct",
      "focus": "We need to handle this customer record.",
      "text": "We need to handle this customer record. Update the visible customer information and retain a history of the change.",
      "noisy_text": "There was also a discussion of a puzzle, its rules, and how long it took to finish. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. Separately, the team discussed a community garden and the date of its next volunteer meeting. We need to handle this customer record. Update the visible customer information and retain a history of the change. Someone added a reminder about a walking route and the location of a public fountain. An unrelated note describes how to arrange photographs by the year they were taken.",
      "split": "held_out"
    },
    {
      "id": "customer_entry:export:q1",
      "target": "customer_entry:export",
      "family": "customer_entry",
      "flavor": "export",
      "focus": "We need to handle this customer record.",
      "text": "We need to handle this customer record. Provide the verified customer a portable copy of the information we hold.",
      "noisy_text": "We also compared the lighting in a hallway with the lighting in a nearby classroom. A separate planning item lists the dates of a local exhibition and its opening reception. An unrelated note describes how to arrange photographs by the year they were taken. We need to handle this customer record. Provide the verified customer a portable copy of the information we hold. Separately, the team discussed a community garden and the date of its next volunteer meeting. Someone added a reminder about a walking route and the location of a public fountain.",
      "split": "held_out"
    },
    {
      "id": "customer_entry:export:q2",
      "target": "customer_entry:export",
      "family": "customer_entry",
      "flavor": "export",
      "focus": "We need to handle this customer record.",
      "text": "We need to handle this customer record. Prepare the owner's requested data export after checking their identity.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We also compared the lighting in a hallway with the lighting in a nearby classroom. We need to handle this customer record. Prepare the owner's requested data export after checking their identity. Separately, the team discussed a community garden and the date of its next volunteer meeting. Another note concerned the weather forecast for a weekend outdoor gathering.",
      "split": "held_out"
    },
    {
      "id": "customer_entry:restrict:q1",
      "target": "customer_entry:restrict",
      "family": "customer_entry",
      "flavor": "restrict",
      "focus": "We need to handle this customer record.",
      "text": "We need to handle this customer record. Limit the staff role to only the customer fields needed for its assigned work.",
      "noisy_text": "Another note concerned the weather forecast for a weekend outdoor gathering. An unrelated note describes how to arrange photographs by the year they were taken. Someone added a reminder about a walking route and the location of a public fountain. We need to handle this customer record. Limit the staff role to only the customer fields needed for its assigned work. Separately, the team discussed a community garden and the date of its next volunteer meeting. A separate planning item lists the dates of a local exhibition and its opening reception.",
      "split": "held_out"
    },
    {
      "id": "customer_entry:restrict:q2",
      "target": "customer_entry:restrict",
      "family": "customer_entry",
      "flavor": "restrict",
      "focus": "We need to handle this customer record.",
      "text": "We need to handle this customer record. Remove unnecessary visibility of this entry from the internal role.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. Another note concerned the weather forecast for a weekend outdoor gathering. We also compared the lighting in a hallway with the lighting in a nearby classroom. We need to handle this customer record. Remove unnecessary visibility of this entry from the internal role. An unrelated note describes how to arrange photographs by the year they were taken. Separately, the team discussed a community garden and the date of its next volunteer meeting.",
      "split": "held_out"
    },
    {
      "id": "notification_ops:schedule:q1",
      "target": "notification_ops:schedule",
      "family": "notification_ops",
      "flavor": "schedule",
      "focus": "We need to handle this notification.",
      "text": "We need to handle this notification. Delay the alert until the recipient's allowed hours.",
      "noisy_text": "Someone added a reminder about a walking route and the location of a public fountain. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. Separately, the team discussed a community garden and the date of its next volunteer meeting. We need to handle this notification. Delay the alert until the recipient's allowed hours. We also compared the lighting in a hallway with the lighting in a nearby classroom. A separate planning item lists the dates of a local exhibition and its opening reception.",
      "split": "held_out"
    },
    {
      "id": "notification_ops:schedule:q2",
      "target": "notification_ops:schedule",
      "family": "notification_ops",
      "flavor": "schedule",
      "focus": "We need to handle this notification.",
      "text": "We need to handle this notification. Keep the event but deliver its message after quiet hours finish.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. We also compared the lighting in a hallway with the lighting in a nearby classroom. Separately, the team discussed a community garden and the date of its next volunteer meeting. We need to handle this notification. Keep the event but deliver its message after quiet hours finish. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. There was also a discussion of a puzzle, its rules, and how long it took to finish.",
      "split": "held_out"
    },
    {
      "id": "notification_ops:route:q1",
      "target": "notification_ops:route",
      "family": "notification_ops",
      "flavor": "route",
      "focus": "We need to handle this notification.",
      "text": "We need to handle this notification. Send this alert to the task owner who can resolve it.",
      "noisy_text": "Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. A separate planning item lists the dates of a local exhibition and its opening reception. An unrelated note describes how to arrange photographs by the year they were taken. We need to handle this notification. Send this alert to the task owner who can resolve it. Another note concerned the weather forecast for a weekend outdoor gathering. Someone added a reminder about a walking route and the location of a public fountain.",
      "split": "held_out"
    },
    {
      "id": "notification_ops:route:q2",
      "target": "notification_ops:route",
      "family": "notification_ops",
      "flavor": "route",
      "focus": "We need to handle this notification.",
      "text": "We need to handle this notification. Route the message to the responsible person instead of the current uninvolved recipient.",
      "noisy_text": "Separately, the team discussed a community garden and the date of its next volunteer meeting. Another note concerned the weather forecast for a weekend outdoor gathering. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We need to handle this notification. Route the message to the responsible person instead of the current uninvolved recipient. An unrelated note describes how to arrange photographs by the year they were taken. A separate planning item lists the dates of a local exhibition and its opening reception.",
      "split": "held_out"
    },
    {
      "id": "notification_ops:deduplicate:q1",
      "target": "notification_ops:deduplicate",
      "family": "notification_ops",
      "flavor": "deduplicate",
      "focus": "We need to handle this notification.",
      "text": "We need to handle this notification. Collapse repeated copies of the same alert without losing its event identity.",
      "noisy_text": "We also compared the lighting in a hallway with the lighting in a nearby classroom. Another note concerned the weather forecast for a weekend outdoor gathering. A separate planning item lists the dates of a local exhibition and its opening reception. We need to handle this notification. Collapse repeated copies of the same alert without losing its event identity. There was also a discussion of a puzzle, its rules, and how long it took to finish. Separately, the team discussed a community garden and the date of its next volunteer meeting.",
      "split": "held_out"
    },
    {
      "id": "notification_ops:deduplicate:q2",
      "target": "notification_ops:deduplicate",
      "family": "notification_ops",
      "flavor": "deduplicate",
      "focus": "We need to handle this notification.",
      "text": "We need to handle this notification. Stop sending redundant messages when the underlying event has not changed.",
      "noisy_text": "There was also a discussion of a puzzle, its rules, and how long it took to finish. We also compared the lighting in a hallway with the lighting in a nearby classroom. An unrelated note describes how to arrange photographs by the year they were taken. We need to handle this notification. Stop sending redundant messages when the underlying event has not changed. A separate planning item lists the dates of a local exhibition and its opening reception. Someone added a reminder about a walking route and the location of a public fountain.",
      "split": "held_out"
    },
    {
      "id": "notification_ops:acknowledge:q1",
      "target": "notification_ops:acknowledge",
      "family": "notification_ops",
      "flavor": "acknowledge",
      "focus": "We need to handle this notification.",
      "text": "We need to handle this notification. Record that the owner saw the delivered alert; this does not finish the task.",
      "noisy_text": "We also compared the lighting in a hallway with the lighting in a nearby classroom. There was also a discussion of a puzzle, its rules, and how long it took to finish. Another note concerned the weather forecast for a weekend outdoor gathering. We need to handle this notification. Record that the owner saw the delivered alert; this does not finish the task. Someone added a reminder about a walking route and the location of a public fountain. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables.",
      "split": "held_out"
    },
    {
      "id": "notification_ops:acknowledge:q2",
      "target": "notification_ops:acknowledge",
      "family": "notification_ops",
      "flavor": "acknowledge",
      "focus": "We need to handle this notification.",
      "text": "We need to handle this notification. Obtain an acknowledgment rather than treating delivery as proof of completion.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. We also compared the lighting in a hallway with the lighting in a nearby classroom. Separately, the team discussed a community garden and the date of its next volunteer meeting. We need to handle this notification. Obtain an acknowledgment rather than treating delivery as proof of completion. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. An unrelated note describes how to arrange photographs by the year they were taken.",
      "split": "held_out"
    },
    {
      "id": "browser_ops:resume:q1",
      "target": "browser_ops:resume",
      "family": "browser_ops",
      "flavor": "resume",
      "focus": "We need to handle this browser session.",
      "text": "We need to handle this browser session. Continue the interrupted page interaction using its surviving browser state.",
      "noisy_text": "An unrelated note describes how to arrange photographs by the year they were taken. We also compared the lighting in a hallway with the lighting in a nearby classroom. A separate planning item lists the dates of a local exhibition and its opening reception. We need to handle this browser session. Continue the interrupted page interaction using its surviving browser state. There was also a discussion of a puzzle, its rules, and how long it took to finish. Separately, the team discussed a community garden and the date of its next volunteer meeting.",
      "split": "held_out"
    },
    {
      "id": "browser_ops:resume:q2",
      "target": "browser_ops:resume",
      "family": "browser_ops",
      "flavor": "resume",
      "focus": "We need to handle this browser session.",
      "text": "We need to handle this browser session. Reconnect to the existing page state rather than starting the interaction over.",
      "noisy_text": "Someone added a reminder about a walking route and the location of a public fountain. Separately, the team discussed a community garden and the date of its next volunteer meeting. A separate planning item lists the dates of a local exhibition and its opening reception. We need to handle this browser session. Reconnect to the existing page state rather than starting the interaction over. There was also a discussion of a puzzle, its rules, and how long it took to finish. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables.",
      "split": "held_out"
    },
    {
      "id": "browser_ops:isolate:q1",
      "target": "browser_ops:isolate",
      "family": "browser_ops",
      "flavor": "isolate",
      "focus": "We need to handle this browser session.",
      "text": "We need to handle this browser session. Keep separate users' authentication and cookies in isolated browsing contexts.",
      "noisy_text": "Someone added a reminder about a walking route and the location of a public fountain. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. An unrelated note describes how to arrange photographs by the year they were taken. We need to handle this browser session. Keep separate users' authentication and cookies in isolated browsing contexts. We also compared the lighting in a hallway with the lighting in a nearby classroom. There was also a discussion of a puzzle, its rules, and how long it took to finish.",
      "split": "held_out"
    },
    {
      "id": "browser_ops:isolate:q2",
      "target": "browser_ops:isolate",
      "family": "browser_ops",
      "flavor": "isolate",
      "focus": "We need to handle this browser session.",
      "text": "We need to handle this browser session. Ensure one person's browser state cannot expose credentials to another user.",
      "noisy_text": "Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. Separately, the team discussed a community garden and the date of its next volunteer meeting. Another note concerned the weather forecast for a weekend outdoor gathering. We need to handle this browser session. Ensure one person's browser state cannot expose credentials to another user. There was also a discussion of a puzzle, its rules, and how long it took to finish. An unrelated note describes how to arrange photographs by the year they were taken.",
      "split": "held_out"
    },
    {
      "id": "browser_ops:diagnose:q1",
      "target": "browser_ops:diagnose",
      "family": "browser_ops",
      "flavor": "diagnose",
      "focus": "We need to handle this browser session.",
      "text": "We need to handle this browser session. Capture console and network evidence of the intermittent page failure.",
      "noisy_text": "Separately, the team discussed a community garden and the date of its next volunteer meeting. Someone added a reminder about a walking route and the location of a public fountain. Another note concerned the weather forecast for a weekend outdoor gathering. We need to handle this browser session. Capture console and network evidence of the intermittent page failure. A separate planning item lists the dates of a local exhibition and its opening reception. There was also a discussion of a puzzle, its rules, and how long it took to finish.",
      "split": "held_out"
    },
    {
      "id": "browser_ops:diagnose:q2",
      "target": "browser_ops:diagnose",
      "family": "browser_ops",
      "flavor": "diagnose",
      "focus": "We need to handle this browser session.",
      "text": "We need to handle this browser session. Collect traces around the failed browser action to determine its cause.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. Another note concerned the weather forecast for a weekend outdoor gathering. Someone added a reminder about a walking route and the location of a public fountain. We need to handle this browser session. Collect traces around the failed browser action to determine its cause. Separately, the team discussed a community garden and the date of its next volunteer meeting. An unrelated note describes how to arrange photographs by the year they were taken.",
      "split": "held_out"
    },
    {
      "id": "browser_ops:revoke:q1",
      "target": "browser_ops:revoke",
      "family": "browser_ops",
      "flavor": "revoke",
      "focus": "We need to handle this browser session.",
      "text": "We need to handle this browser session. Invalidate the sign-in state on the lost device.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. Separately, the team discussed a community garden and the date of its next volunteer meeting. Another note concerned the weather forecast for a weekend outdoor gathering. We need to handle this browser session. Invalidate the sign-in state on the lost device. We also compared the lighting in a hallway with the lighting in a nearby classroom. An unrelated note describes how to arrange photographs by the year they were taken.",
      "split": "held_out"
    },
    {
      "id": "browser_ops:revoke:q2",
      "target": "browser_ops:revoke",
      "family": "browser_ops",
      "flavor": "revoke",
      "focus": "We need to handle this browser session.",
      "text": "We need to handle this browser session. Prevent the missing device from continuing to act as the signed-in owner.",
      "noisy_text": "An unrelated note describes how to arrange photographs by the year they were taken. A separate planning item lists the dates of a local exhibition and its opening reception. Another note concerned the weather forecast for a weekend outdoor gathering. We need to handle this browser session. Prevent the missing device from continuing to act as the signed-in owner. Separately, the team discussed a community garden and the date of its next volunteer meeting. Someone added a reminder about a walking route and the location of a public fountain.",
      "split": "held_out"
    },
    {
      "id": "email_ops:hold:q1",
      "target": "email_ops:hold",
      "family": "email_ops",
      "flavor": "hold",
      "focus": "We need to handle this email.",
      "text": "We need to handle this email. Keep the prepared reply unsent because delivery has not been authorized.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. An unrelated note describes how to arrange photographs by the year they were taken. There was also a discussion of a puzzle, its rules, and how long it took to finish. We need to handle this email. Keep the prepared reply unsent because delivery has not been authorized. Someone added a reminder about a walking route and the location of a public fountain. Another note concerned the weather forecast for a weekend outdoor gathering.",
      "split": "held_out"
    },
    {
      "id": "email_ops:hold:q2",
      "target": "email_ops:hold",
      "family": "email_ops",
      "flavor": "hold",
      "focus": "We need to handle this email.",
      "text": "We need to handle this email. Hold this completed message for approval instead of delivering it.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. An unrelated note describes how to arrange photographs by the year they were taken. We also compared the lighting in a hallway with the lighting in a nearby classroom. We need to handle this email. Hold this completed message for approval instead of delivering it. Another note concerned the weather forecast for a weekend outdoor gathering. There was also a discussion of a puzzle, its rules, and how long it took to finish.",
      "split": "held_out"
    },
    {
      "id": "email_ops:deliver:q1",
      "target": "email_ops:deliver",
      "family": "email_ops",
      "flavor": "deliver",
      "focus": "We need to handle this email.",
      "text": "We need to handle this email. Deliver the final wording to the confirmed recipient now that the owner approved it.",
      "noisy_text": "There was also a discussion of a puzzle, its rules, and how long it took to finish. An unrelated note describes how to arrange photographs by the year they were taken. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We need to handle this email. Deliver the final wording to the confirmed recipient now that the owner approved it. We also compared the lighting in a hallway with the lighting in a nearby classroom. A separate planning item lists the dates of a local exhibition and its opening reception.",
      "split": "held_out"
    },
    {
      "id": "email_ops:deliver:q2",
      "target": "email_ops:deliver",
      "family": "email_ops",
      "flavor": "deliver",
      "focus": "We need to handle this email.",
      "text": "We need to handle this email. Send the reviewed message under the explicit authorization already given.",
      "noisy_text": "An unrelated note describes how to arrange photographs by the year they were taken. Separately, the team discussed a community garden and the date of its next volunteer meeting. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We need to handle this email. Send the reviewed message under the explicit authorization already given. Someone added a reminder about a walking route and the location of a public fountain. We also compared the lighting in a hallway with the lighting in a nearby classroom.",
      "split": "held_out"
    },
    {
      "id": "email_ops:recipient:q1",
      "target": "email_ops:recipient",
      "family": "email_ops",
      "flavor": "recipient",
      "focus": "We need to handle this email.",
      "text": "We need to handle this email. Confirm the intended recipient's identity and address before sending.",
      "noisy_text": "Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. Another note concerned the weather forecast for a weekend outdoor gathering. We also compared the lighting in a hallway with the lighting in a nearby classroom. We need to handle this email. Confirm the intended recipient's identity and address before sending. Someone added a reminder about a walking route and the location of a public fountain. A separate planning item lists the dates of a local exhibition and its opening reception.",
      "split": "held_out"
    },
    {
      "id": "email_ops:recipient:q2",
      "target": "email_ops:recipient",
      "family": "email_ops",
      "flavor": "recipient",
      "focus": "We need to handle this email.",
      "text": "We need to handle this email. Resolve who should receive this reply before attempting delivery.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. An unrelated note describes how to arrange photographs by the year they were taken. Separately, the team discussed a community garden and the date of its next volunteer meeting. We need to handle this email. Resolve who should receive this reply before attempting delivery. Another note concerned the weather forecast for a weekend outdoor gathering. Someone added a reminder about a walking route and the location of a public fountain.",
      "split": "held_out"
    },
    {
      "id": "email_ops:tracking:q1",
      "target": "email_ops:tracking",
      "family": "email_ops",
      "flavor": "tracking",
      "focus": "We need to handle this email.",
      "text": "We need to handle this email. Add campaign attribution to the link in the approved message.",
      "noisy_text": "There was also a discussion of a puzzle, its rules, and how long it took to finish. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. Separately, the team discussed a community garden and the date of its next volunteer meeting. We need to handle this email. Add campaign attribution to the link in the approved message. Another note concerned the weather forecast for a weekend outdoor gathering. A separate planning item lists the dates of a local exhibition and its opening reception.",
      "split": "held_out"
    },
    {
      "id": "email_ops:tracking:q2",
      "target": "email_ops:tracking",
      "family": "email_ops",
      "flavor": "tracking",
      "focus": "We need to handle this email.",
      "text": "We need to handle this email. Preserve the approved wording while correcting the link's tracking parameters.",
      "noisy_text": "A separate planning item lists the dates of a local exhibition and its opening reception. Someone added a reminder about a walking route and the location of a public fountain. Another conversation concerned a recipe with lentils, herbs, and roasted vegetables. We need to handle this email. Preserve the approved wording while correcting the link's tracking parameters. Separately, the team discussed a community garden and the date of its next volunteer meeting. We also compared the lighting in a hallway with the lighting in a nearby classroom.",
      "split": "held_out"
    }
  ],
  "generic_queries": [
    {
      "id": "api_secret:generic",
      "family": "api_secret",
      "focus": "We need to handle this API key.",
      "text": "We need to handle this API key.",
      "targets": [
        "api_secret:rotate",
        "api_secret:scope",
        "api_secret:storage",
        "api_secret:audit"
      ],
      "split": "held_out"
    },
    {
      "id": "conversation_archive:generic",
      "family": "conversation_archive",
      "focus": "We need to handle this conversation.",
      "text": "We need to handle this conversation.",
      "targets": [
        "conversation_archive:summary",
        "conversation_archive:restore",
        "conversation_archive:share",
        "conversation_archive:erase"
      ],
      "split": "held_out"
    },
    {
      "id": "classifier_ops:generic",
      "family": "classifier_ops",
      "focus": "We need to handle this classifier.",
      "text": "We need to handle this classifier.",
      "targets": [
        "classifier_ops:diagnose",
        "classifier_ops:retrain",
        "classifier_ops:monitor",
        "classifier_ops:rollback"
      ],
      "split": "held_out"
    },
    {
      "id": "image_ops:generic",
      "family": "image_ops",
      "focus": "We need to handle this image.",
      "text": "We need to handle this image.",
      "targets": [
        "image_ops:compress",
        "image_ops:resize",
        "image_ops:redact",
        "image_ops:inspect"
      ],
      "split": "held_out"
    },
    {
      "id": "customer_entry:generic",
      "family": "customer_entry",
      "focus": "We need to handle this customer record.",
      "text": "We need to handle this customer record.",
      "targets": [
        "customer_entry:recover",
        "customer_entry:correct",
        "customer_entry:export",
        "customer_entry:restrict"
      ],
      "split": "held_out"
    },
    {
      "id": "notification_ops:generic",
      "family": "notification_ops",
      "focus": "We need to handle this notification.",
      "text": "We need to handle this notification.",
      "targets": [
        "notification_ops:schedule",
        "notification_ops:route",
        "notification_ops:deduplicate",
        "notification_ops:acknowledge"
      ],
      "split": "held_out"
    },
    {
      "id": "browser_ops:generic",
      "family": "browser_ops",
      "focus": "We need to handle this browser session.",
      "text": "We need to handle this browser session.",
      "targets": [
        "browser_ops:resume",
        "browser_ops:isolate",
        "browser_ops:diagnose",
        "browser_ops:revoke"
      ],
      "split": "held_out"
    },
    {
      "id": "email_ops:generic",
      "family": "email_ops",
      "focus": "We need to handle this email.",
      "text": "We need to handle this email.",
      "targets": [
        "email_ops:hold",
        "email_ops:deliver",
        "email_ops:recipient",
        "email_ops:tracking"
      ],
      "split": "held_out"
    }
  ],
  "noise_sentences": [
    "Separately, the team discussed a community garden and the date of its next volunteer meeting.",
    "An unrelated note describes how to arrange photographs by the year they were taken.",
    "Another conversation concerned a recipe with lentils, herbs, and roasted vegetables.",
    "We also compared the lighting in a hallway with the lighting in a nearby classroom.",
    "A separate planning item lists the dates of a local exhibition and its opening reception.",
    "Someone added a reminder about a walking route and the location of a public fountain.",
    "There was also a discussion of a puzzle, its rules, and how long it took to finish.",
    "Another note concerned the weather forecast for a weekend outdoor gathering."
  ]
}