## Web Demonstration and Explanation Dataset (Web-D-E)
This data was collected for and used in our ACL 2020 paper [1] that demonstrates the potential to effectively combine explanations and demonstrations to learn web-based procedures. This data consists of 520 explanations and corresponding demonstrations of web-based tasks from the Mini Word-of-Bits from [2].

**File Types**: `tsv, json, md, docx`

**License Agreement**:  Open Use of Data Agreement v1.0 (O-UDA V.1.0). See the file `LicenseAgreement.md` for more information.

The data is organized as follows:

1. Each line of `explanations-mappings.tsv` has four columns `(SessionID, Task, Explanation, Demonstration)` in tab-separated format:
    * The `SessionID` is the id for a recorded `(Explanation, Demonstration)` pair
    * The `Task` column contains the name of the task.
    * The `Explanation` column contains the natural language explanation text: texts for individual steps (as obtained via crowdsourcing) are separated with a pipe (|) symbol.
    * The `Demonstration` column contains the name of a file that contains the demonstration.

2. The `demonstrations` directory contains a set of JSON files with one demonstration per file. The format of the demonstrations follows that from the [MiniWoB++ framework](https://github.com/stanfordnlp/miniwob-plusplus).

### References

[1]  [Learning Web-based Procedures by Reasoning over Explanations and Demonstrations in Context](https://www.microsoft.com/en-us/research/publication/learning-web-based-procedures-by-reasoning-over-explanations-and-demonstrations-in-context/). Shashank Srivastava, Oleksandr Polozov, Nebojsa Jojic, Christopher Meek. ACL, 2020. 

[2] [Reinforcement Learning on Web Interfaces using Workflow-Guided Exploration](https://arxiv.org/abs/1802.08802).
Evan Zheran Liu*, Kelvin Guu*, Panupong Pasupat*, Tianlin Shi, Percy Liang
ICLR, 2018.