WF member data fun

Discussion in 'The Workshop' started by mburtonk, Dec 5, 2014.

  1. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    I'm diving a little deeper into R, so I needed a dataset to play with. Seems the first and last activity of a subset of WF members is easy enough for me to enter into a spreadsheet. This is all public info if you are logged in; I can't see this info for members who have restricted profiles.

    See attached file (updated as I add more people).

    Time increases on the x-axis. Members are sorted by first appearance date (registration date) from the bottom up (still working on sorting the other way, but I did at least get it to stop sorting alphabetically).

    Data file looks like this:
    Name,Date
    Chuck,2004-03-23
    Chuck,2014-12-03
    Elwood,2004-03-23
    Elwood,2014-12-03
    Chris,2004-03-23
    Chris,2014-03-31
    Aurora,2004-03-23
    Aurora,2014-12-03
    Jeriko,2004-03-23
    Jeriko,2005-12-24
    gul,2004-03-23
    gul,2014-12-03

    Attached Files:

    Last edited: Dec 6, 2014
    • Agree Agree x 3
  2. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    Muad Dib is wrong, stand by. Fixed. That's what you get for manual data entry.
  3. El Chup

    El Chup Fuck Trump Deceased Member Git

    Joined:
    Mar 27, 2004
    Messages:
    42,875
    Ratings:
    +27,831
    List.



    Didn't make.



    Cunt.
    • Agree Agree x 3
  4. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    :nyer:
  5. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    A valid message.

    Attached Files:

    • wf2.pdf
      File size:
      215.4 KB
      Views:
      10
  6. El Chup

    El Chup Fuck Trump Deceased Member Git

    Joined:
    Mar 27, 2004
    Messages:
    42,875
    Ratings:
    +27,831
    Not getting away with it that easily.... :bailey:
  7. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    If anyone wants to help enter data, I can send you a link to a spreadsheet on Google Drive. If you are worried about your identity showing up under the list of users, you can use Incognito Mode (Chrome) or similar, and you'll just show up as Anonymous.

    The alternative is for one of the technical staff to send me useful data from the database directly. With an export of the User and Postdate fields from the posts table, for example, we could build a beanplot showing how people's posting has varied through time (posts per unit time). The reason the bars on the chart look so weird right now is that I only have two dates for each member: registration date and "last active" date.

    If this doesn't seem "creativey" enough, mods can feel free to move.
  8. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    Update because I had 5 minutes.

    Attached Files:

    • wf3.pdf
      File size:
      291 KB
      Views:
      8
  9. gul

    gul Revolting Beer Drinker Administrator Formerly Important

    Joined:
    Mar 23, 2004
    Messages:
    52,375
    Location:
    Boston
    Ratings:
    +42,367
    It's odd that 2007 to 2012 look so lean.
  10. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    Yeah. I've done this another way before, but it takes more finagling. The beanplot package is relatively simple.
  11. garamet

    garamet "The whole world is watching."

    Joined:
    Apr 2, 2004
    Messages:
    59,487
    Ratings:
    +48,916
    Isn't that when the Mysterious Meltdown ate a whole bunch of posts? :unsure:
    • Agree Agree x 1
  12. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    It might be, but that isn't reflected on this graph. The skinny lines in there are an artifact of just using two data points with a plot that isn't designed for that.
    • Agree Agree x 2
  13. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    Some more! I'm working my way down according to most posts now.

    Attached Files:

  14. ed629

    ed629 Morally Inept Banned

    Joined:
    Apr 10, 2004
    Messages:
    14,722
    Ratings:
    +17,792
    I made a list!

    Is this good or bad?
  15. Chuck

    Chuck Go Giants!

    Joined:
    Mar 23, 2004
    Messages:
    17,931
    Location:
    Tea Party shithole
    Ratings:
    +8,887
    Top of the list :bananana:
  16. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    File in first post has been replaced/updated. This way I won't have a ton of duplicates floating around.
  17. tafkats

    tafkats scream not working because space make deaf Moderator

    Joined:
    Mar 27, 2004
    Messages:
    24,904
    Location:
    Sunnydale
    Ratings:
    +50,916
    Can you explain what we're looking at? I assume each line's extent along the X-axis represents the period of time that user was active. What is the Y-axis within each line? Posting volume?
  18. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    Think of it as no y-axis. It's an artifact of the plot that thickness changes. I am looking for a different visualization for this type of data (all the questions are good feedback).
  19. Paladin

    Paladin Overjoyed Man of Liberty

    Joined:
    Mar 29, 2004
    Messages:
    50,154
    Location:
    Spacetime
    Ratings:
    +53,511
    We do not speak of the Great Forgetting.
    • Agree Agree x 1
  20. Bickendan

    Bickendan Custom Title Administrator Faceless Mook Writer

    Joined:
    May 7, 2010
    Messages:
    23,848
    Ratings:
    +28,278
    That gap between Sandbagger and Larry though. :unsure:
  21. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    Bick, I think that's because I was entering people in order of registration date number of posts, except for some people at the tail end. So the gap in there represents the folks with less than 600 or so posts that I haven't yet entered. Since post count usually coincides with registration date, it shows up like this.
  22. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    Updated again. Includes everyone who has more than 50 posts and doesn't have a private profile.
  23. Zor Prime

    Zor Prime .

    Joined:
    Dec 28, 2013
    Messages:
    1,695
    Ratings:
    +3,475
    Another list I didn't make! ;)

    So many long gone users...

    It makes me wonder what this board would be like now if none of those people had left and our membership had kept building and building.

    Definitely miss some of the different viewpoints from folks like Ms Albert, TKO, Lethesoda, markb, Herpetolgist, Reno Floyd, etc

    One interesting thing I noticed. If you zoom out of the graph and look at the whole thing at once, you notice that most of the people who joined prior to 2006 are still here.. but after that you notice that many people who joined since then did not stick around as long... and it gets worse as time goes.

    As an example, Federal Farmer is a relative n00b and he was ready to quit the place after just a few months here. He is back now of course and ultimately decided not to wimp out ;)

    But it seems like the core group of people who joined back in 2004 are still here.

    Others since then have come and gone....
    Last edited: Dec 16, 2014
    • Agree Agree x 1
  24. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    Zor, I couldn't see your profile when I was going through them all, so I skipped you. It looks like you joined 2013-12-28 though.
  25. Zor Prime

    Zor Prime .

    Joined:
    Dec 28, 2013
    Messages:
    1,695
    Ratings:
    +3,475
    That's ok, I'm already on the list! ;)
    • Agree Agree x 1
  26. Bickendan

    Bickendan Custom Title Administrator Faceless Mook Writer

    Joined:
    May 7, 2010
    Messages:
    23,848
    Ratings:
    +28,278
    I could have sworn teh baba has posted since the Reign of Teal ended :chris:
  27. gul

    gul Revolting Beer Drinker Administrator Formerly Important

    Joined:
    Mar 23, 2004
    Messages:
    52,375
    Location:
    Boston
    Ratings:
    +42,367
  28. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    Might have entered the year wrong.
  29. mburtonk

    mburtonk mburtonkulous

    Joined:
    Dec 6, 2004
    Messages:
    10,508
    Location:
    Minnesnowta
    Ratings:
    +7,626
    Again, I haven't updated any of the data for over a year, but here it is sorted by when people stopped posting.

    wfout_end.png
    • Love Love x 2
    • Agree Agree x 1
  30. ed629

    ed629 Morally Inept Banned

    Joined:
    Apr 10, 2004
    Messages:
    14,722
    Ratings:
    +17,792
    :soma: I made a list!
    • Agree Agree x 2