ADRIFT Forum


The place to discuss the ADRIFT Interactive Fiction toolkit

Annual IF Comp 2018

The home for all discussion of competitions for ADRIFT and multiformat IF

Re: Annual IF Comp 2018

Postby The0didactus » Fri Nov 16, 2018 2:52 pm

I think your scores are accurate. I was pretty happy with most of the blog-based reviews of 6SB, and I know via email it was at least one person's favorite game...but I believe this was more than balanced out by a few reviews that didn't disclose a score but seemed pretty negative, and the constant low-level madness induced by the game's stingy parser. I'd be happy with a 6 or a 6.5, and thrilled with a 7.

So we're all close together you think? Nice grouping.
https://www.youtube.com/watch?v=8BF95hdIuOg
The0didactus
 
Posts: 248
Joined: Sun Mar 30, 2014 8:20 pm
Points: 105

Re: Annual IF Comp 2018

Postby P/o Prune » Fri Nov 16, 2018 5:17 pm

Denk wrote:
The0didactus wrote:How do you think we did?
Based on the far too limited available data (2 public ratings for each game) the scores might be:

Anno 1700: 6
Six Silver Bullets: 6
Stone of Wisdom: 5,5

Resulting in 30th, 30th and 37th place respectively compared to last years result. I'm probably completely wrong but it is fun to guess.


This is where I have a "problem"

First of all let me say that I feel that a 30th place out of 77 isn't bad and I'm pretty happy if that's the way the score goes.
However, I can't help but feel that there's a "problem" regarding the way the scores are set.

If a game only gets 3 reviews (and scores) how is it to compare with other games that receive multiple scores?

I haven't checked, so I don't know if people are scoring games without writing reviews (is it possible?) but I'm just wondering. Is (in this case) Adrift games at a disadvantage from the beginning?
Not that it matters much. I'm just curious, trying to understand the way the scoring system works in the Annual IFComp.
I'm already working on my entry for the 2019 Annual IFComp. 8)
D-Day in progress 86Kb (Slowly drifting)
Just a Fairy Tale: 64Kb
User avatar
P/o Prune
Site Admin
 
Posts: 4432
Joined: Mon Jun 24, 2002 8:18 am
Location: Denmark
Points: 58

Re: Annual IF Comp 2018

Postby Denk » Fri Nov 16, 2018 5:45 pm

There were 247 judges this year, far more than there are reviewers, so you will most likely get more ratings than reviews.

The scoring system is based on the average score, e.g. if you receive ten ratings of 6, your average score will be 6. Somebody who receives 100 ratings of 6 will also have an average score of 6. So it is not necessarily an advantage to get many ratings. However, maybe there is a rule(?) if you get too few ratings you will not get a score. I am concerned about this, even though I don't think it has happened before in IFcomp history.
----------------------------------------------------------------------
The Bash Saga:
1. The Dragon Diamond 2. The Way Home 3. Stone of Wisdom
----------------------------------------------------------------------
Denk
 
Posts: 282
Joined: Mon Feb 22, 2016 6:21 pm
Location: Hjørring, Denmark
Points: 56

Re: Annual IF Comp 2018

Postby David Whyld » Fri Nov 16, 2018 5:46 pm

Aren’t the games assigned an average score based on the number of votes?
David Whyld
 
Posts: 6921
Joined: Sat Dec 18, 2004 5:15 pm
Location: United Kingdom
Points: 35

Re: Annual IF Comp 2018

Postby ralphmerridew » Fri Nov 16, 2018 8:39 pm

Games must get at least 10 votes or they will be disqualified. The game "Promoted" was OS/2 only and got insufficient votes.

The rest of Denk's post is correct.
Bloodhounds can make you laugh and cuss in the same breath. They are endearing, faithful, and can sling drool ten feet in any direction. -- Virginia Lanier
User avatar
ralphmerridew
 
Posts: 2575
Joined: Fri Dec 13, 2002 11:56 pm
Location: Missouri
Points: 10

Re: Annual IF Comp 2018

Postby The0didactus » Fri Nov 16, 2018 9:34 pm

There's always a potential for bias for small sample sizes, but this is just as likely to work in your favor as against it. One of the nicest responses I got was from someone who, I suspect, does not play much interactive fiction. If that was one of 3 reviews, he'd have seriously pulled "up" my score.

It's not gonna be a problem this year, this is the busiest year in a while, it seems like, so I bet everyone has plenty of reviews., even on more onerous systems like ours.

Prune, I have started work on my submission as well, though it will be a very different sort of game than 6SB so I don't know how much the lessons I've learned this year will carry over. I look forward to running again with y'all next year.
The0didactus
 
Posts: 248
Joined: Sun Mar 30, 2014 8:20 pm
Points: 105

Re: Annual IF Comp 2018

Postby ralphmerridew » Sat Nov 17, 2018 11:54 am

Judges just have to put down a score. Writing a review takes a lot more work.
Bloodhounds can make you laugh and cuss in the same breath. They are endearing, faithful, and can sling drool ten feet in any direction. -- Virginia Lanier
User avatar
ralphmerridew
 
Posts: 2575
Joined: Fri Dec 13, 2002 11:56 pm
Location: Missouri
Points: 10

Re: Annual IF Comp 2018

Postby P/o Prune » Sat Nov 17, 2018 1:52 pm

ralphmerridew wrote:Judges just have to put down a score. Writing a review takes a lot more work.

I realize that now. I somehow thought that the two went together, though.
Would be interesting to find out how many actually scored on your game, meaning that they must have played through it, at least partly.
D-Day in progress 86Kb (Slowly drifting)
Just a Fairy Tale: 64Kb
User avatar
P/o Prune
Site Admin
 
Posts: 4432
Joined: Mon Jun 24, 2002 8:18 am
Location: Denmark
Points: 58

Re: Annual IF Comp 2018

Postby David Whyld » Sat Nov 17, 2018 2:20 pm

I think it gives the number of voters on the IFComp website afterwards.
David Whyld
 
Posts: 6921
Joined: Sat Dec 18, 2004 5:15 pm
Location: United Kingdom
Points: 35

Re: Annual IF Comp 2018

Postby Denk » Sat Nov 17, 2018 5:36 pm

If some of you don't know, the main results will be announced in about 2.5 hours from now on Twitch.

Read more about it here: http://blog.ifcomp.org/

Later (when? tomorrow?) the results should be visible on https://ifcomp.org/ including statistics for each game.
----------------------------------------------------------------------
The Bash Saga:
1. The Dragon Diamond 2. The Way Home 3. Stone of Wisdom
----------------------------------------------------------------------
Denk
 
Posts: 282
Joined: Mon Feb 22, 2016 6:21 pm
Location: Hjørring, Denmark
Points: 56

Re: Annual IF Comp 2018

Postby David Whyld » Sat Nov 17, 2018 8:33 pm

The results have just been announced on Twitch. No wins for ADRIFT games, but they did as follows:

31. Six Silver Bullets
44. Stone of Wisdom
61. Anno 1700

Full results are up on the IFComp website at https://ifcomp.org/comp/2018

And special mention to former drifter J J Guest - AKA the Amazing Poodle Boy - who came first place with Alias the Magpie.
David Whyld
 
Posts: 6921
Joined: Sat Dec 18, 2004 5:15 pm
Location: United Kingdom
Points: 35

Re: Annual IF Comp 2018

Postby P/o Prune » Sat Nov 17, 2018 8:38 pm

David Whyld wrote:The results have just been announced on Twitch. No wins for ADRIFT games, but they did as follows:

31. Six Silver Bullets
44. Stone of Wisdom
61. Anno 1700

Full results are up on the IFComp website at https://ifcomp.org/comp/2018

And special mention to former drifter J J Guest - AKA the Amazing Poodle Boy - who came first place with Alias the Magpie.


:yeah:
Congrats to all participants. Job well done :thanks:
Good to see an "old drifter" go up first :D
D-Day in progress 86Kb (Slowly drifting)
Just a Fairy Tale: 64Kb
User avatar
P/o Prune
Site Admin
 
Posts: 4432
Joined: Mon Jun 24, 2002 8:18 am
Location: Denmark
Points: 58

Re: Annual IF Comp 2018

Postby David Whyld » Sat Nov 17, 2018 11:01 pm

As far as voting went, I think the lack of online play really hurt ADRIFT. Only four games got less than 30 votes in the whole competition and three were the ADRIFT entries, and yes they were the lowest voted games of all. Quite a few games got more votes on their own than the ADRIFT entries combined. With no online play and no way to play the games on anything but Windows, that's a sizeable portion of potential judges who couldn't even play the ADRIFT games Whatever else needs fixing here, online play should be the number one priority.
David Whyld
 
Posts: 6921
Joined: Sat Dec 18, 2004 5:15 pm
Location: United Kingdom
Points: 35

Re: Annual IF Comp 2018

Postby The0didactus » Sat Nov 17, 2018 11:10 pm

My big project over the winter holiday is going to be to turn one of my old computers into a permanent web server, to better host my stuff and help with some professional projects. I would also like to try to host my ADRIFT games through this (though I don't know much about how).

Next year, if a better solution has not been worked out, I would like to offer any IFCOMP entry to use this server to run their game, because I agree with david that a lack of online play did hurt us,
The0didactus
 
Posts: 248
Joined: Sun Mar 30, 2014 8:20 pm
Points: 105

Re: Annual IF Comp 2018

Postby bdmoon » Thu May 02, 2019 2:47 am

Hello, interesting.

https://ifcomp.org/comp/2018

I list the tools used by contestants. ( From the 1st place winner to the 30th place winner.)

1. Inform 7
2. Twine
3. Twine
4. Twine
5. Twine
6. Twine
7. Inform 7
8. Twine
9. AXMA Story Maker
10, Twine
11. Quest
12. Twine
13. unknown
14. Inform 7
15. Twine
16. Inform 7
17. Inform 7
18. INSTEAD
19. Twine
20. Inform 7
20. Twine
22. Twine
23. Dialog
24. Inform 7
25. Inform 7
26. Inform 7
27. ChoiceScript
28. Inform 7
29. Twine
30. Inform 7
bdmoon
 
Posts: 4
Joined: Sun Apr 21, 2019 1:00 pm

PreviousNext

Return to Competitions

Who is online

Users browsing this forum: No registered users and 1 guest