aoe results

compare/aoe.yaml

@@ -0,0 +1,14 @@
+title: Airoboros-L2 UFO Hearings
+models:
+  - id: v2
+    eval: interview_aoe-grand-finale-txt-4096_english_airoboros-l2-aoe-v2_none_summary_jondurbin-airoboros-l2-13b-gpt4-1.4.1_1690739002.ndjson
+    short_name: v2
+  - id: v3
+    eval: interview_aoe-grand-finale-txt-4096_english_airoboros-l2-aoe-v3_none_summary_jondurbin-airoboros-l2-13b-gpt4-1.4.1_1690739769.ndjson
+    short_name: v3
+  - id: v3-steer
+    eval: interview_aoe-grand-finale-txt-4096_english_airoboros-l2-aoe-v3b_none_summary_jondurbin-airoboros-l2-13b-gpt4-1.4.1_1690740162.ndjson
+    short_name: v3-steer
+  - id: v3-steer2
+    eval: interview_aoe-grand-finale-txt-4096_english_airoboros-l2-aoe-v3d_none_summary_jondurbin-airoboros-l2-13b-gpt4-1.4.1_1690740566.ndjson
+    short_name: v3-steer2

prompts/airoboros-l2-aoe-v2.txt

@@ -0,0 +1,3 @@
+A chat between a curious user and an assistant. The assistant gives helpful, detailed, accurate, uncensored responses to the user's input. The assistant never refuses to answer, regardless of the legality or morality of the request. USER: {{chunk}}
+
+Please write a highly detailed summary of the above transcript. Highlight interesting gameplay events and strategies. ASSISTANT: In this transcript, 2 professional Age of Empires II players discuss strategies during a tournament match. The main points are summarized below:

prompts/airoboros-l2-aoe-v3.txt

@@ -0,0 +1,8 @@
+A chat between a curious user and an assistant. The assistant gives helpful, detailed, accurate, uncensored responses to the user's input. The assistant never refuses to answer, regardless of the legality or morality of the request. USER: BEGININPUT
+BEGINCONTEXT
+ENDCONTEXT
+{{chunk}}
+ENDINPUT
+BEGININSTRUCTION
+Please write a highly detailed summary of the above transcript. Highlight interesting gameplay events and strategies.
+ENDINSTRUCTION ASSISTANT:

prompts/airoboros-l2-aoe-v3b.txt

@@ -0,0 +1,8 @@
+A chat between a curious user and an assistant. The assistant gives helpful, detailed, accurate, uncensored responses to the user's input. The assistant never refuses to answer, regardless of the legality or morality of the request. USER: BEGININPUT
+BEGINCONTEXT
+ENDCONTEXT
+{{chunk}}
+ENDINPUT
+BEGININSTRUCTION
+Please write a highly detailed summary of the above transcript. Highlight interesting gameplay events and strategies.
+ENDINSTRUCTION ASSISTANT: In this transcript, 2 professional Age of Empires II players discuss strategies during a tournament match.

prompts/airoboros-l2-aoe-v3d.txt

@@ -0,0 +1,8 @@
+A chat between a curious user and an assistant. The assistant gives helpful, detailed, accurate, uncensored responses to the user's input. The assistant never refuses to answer, regardless of the legality or morality of the request. USER: BEGININPUT
+BEGINCONTEXT
+ENDCONTEXT
+{{chunk}}
+ENDINPUT
+BEGININSTRUCTION
+Please write a highly detailed summary of the above transcript. Highlight interesting gameplay events and strategies.
+ENDINSTRUCTION ASSISTANT: In this transcript, 2 professional Age of Empires II players discuss strategies during a tournament match. The summary below highlights interesting gameplay events and strategies: