# How to Run LLM Prompt Experiments

> Run experiments with historical datasets to test, evaluate, and improve prompts over time while preventing regressions in production systems.

<Warning>
  We are deprecating the Experiments feature and it will be removed from the platform on September 1st, 2025.
</Warning>

## Feature Highlight

- Create as many prompt versions as you like, without impacting production data.
- Evaluate the outputs of your new prompt (and have data to back you up 📈).
- Save cost by testing on specific datasets and making fewer calls to providers like OpenAI. 🤑

## Running your first prompt experiment

To start an experiment, first, go to the [Prompts](https://www.helicone.ai/prompts) tab and select a prompt.

<Steps>
  <Step title="Click `Start Experiment`">
    On the top right, click `Start Experiment`.
    <Frame>
  <img src="/images/use-cases/experiments/start-button.png" alt="Start button in the Prompts tab for initiating an experiment in Helicone."/>
</Frame>

  </Step>
  <Step title="Select the base prompt">
    Select a base prompt and click `Continue`. You can edit the prompt in the
    next step.
    <Tip>
      To run an experiment on the production prompt, look for the `production`
      tag.
    </Tip>
       <Frame>
  <img src="/images/use-cases/experiments/select-prompt.png" alt="Selecting a base prompt to start an experiment in Helicone."/>
</Frame>

  </Step>
  <Step title="Edit the prompt">
    Your changes will not affect the original prompt, but rather create a new
    one to test your experiment on.
       <Frame>
  <img src="/images/use-cases/experiments/edit-prompt.png" alt="Editing a prompt without affecting the original prompt in production."/>
</Frame>
  </Step>
  <Step title="Configure your experiment">
    Select the dataset, model and provider keys.
    <Tip>
      To run your experiment on a random dataset, click `Generate random
      dataset`. We will pick up to 10 random data from your existing
      requests.{" "}
    </Tip>
       <Frame>
  <img src="/images/use-cases/experiments/config.png" alt="Configuring an experiment with a different dataset, model, and provider keys in Helicone."/>
</Frame>

  </Step>
  <Step title="Confirm and run">
    The `Diff Viewer` compares your new prompt to the base prompt that you
    selected.
       <Frame>
  <img src="/images/use-cases/experiments/confirm.png" alt="Confirming changes to your prompt in Helicone's Diff Viewer before running an experiment. "/>
</Frame>

  </Step>
  <Step title="View outputs">
    Once the experiment is finished, click on it to see a list of inputs and the
    associated outputs from the base prompt and the experiment.
       <Frame>
  <img src="/images/use-cases/experiments/view.png" alt="Comparing the outputs of an experiment compared to the original prompt in Helicone."/>
</Frame>

  </Step>
</Steps>