Author Topic: Hacker News Analysis  (Read 64 times)

0 Members and 1 Guest are viewing this topic.

Offline Flavio58

Hacker News Analysis
« Reply #1 on: July 11, 2018, 08:02:26 PM »
Advertisement
Hacker News Analysis

I was playing around with the Hacker News database Ronnie Roller made (thanks!), so I thought I’d post some of the things I looked at.



 

Activity on the Site



 

My first question was how activity on the site has increased over time. I looked at number of posts, points on posts, comments on posts, and number of users.



 

Posts



 

Hacker News Posts by Month



 

This looks like a strong linear fit, with an increase of 292 posts every month.



 

Comments



 

For comments, I fit a quadratic regression:



 

Hacker News Comments by Month



 

Points



 

A quadratic regression was also a better fit for points by month:



 

Hacker News Points by Month



 

Users



 

And again for the number of distinct users with a submission:



 

Hacker News Users by Month



 

Points and Comments



 

My next question was how points and comments related. Intuitively, posts with more points should have more comments, but it’s nice to check (maybe really good posts are kind of boring, so don’t lead to much discussion).



 

First, I plotted the points and comments of each individual post:



 

All Points vs. Comments



 

As expected, there’s an overall positive correlation between points and comments. Interestingly, there are quite a few high-points posts with no comments.



 

The plot’s quite noisy, though, so let’s try cleaning it up a bit, by taking the median number of comments per points level (and removing posts at the higher end, where we have little data):



 

Points vs. Median Comments



 

We see that posts with more points do tend to have more comments. Also, variance in number of comments is indicated by size and color, so (unsurprisingly) posts with more points have larger variance in their number of comments.



 

Quality of Posts



 

Another question was whether the quality of posts has degraded over time.



 

First, I computed a normalized “score” for each post, where a post’s score is defined as the number of points divided by the number of distinct users who made a submission in the same month. (The denominator is a rough proxy for the number of active users, and the goal of the score is to provide a way to compare posts across time.)



 

While the median score has declined over time (as perhaps should be expected, since only a fixed number of items can reach the front page):



 

Median Score



 

the absolute number of quality posts, defined as posts with a score greater than the (admittedly arbitrarily chosen) threshold 0.01, has increased (until possibly a dip starting in 2010):



 

Number of Quality Posts



 

(Of course, without some further analysis, it’s not clear how well this score measures quality of posts, so take these numbers with a grain of salt.)



 

Company Trends



 

Also, I wanted to see how certain topics have trended over time, so I looked at how mentions of some of the big-name companies (Google, Facebook, Microsoft, Yahoo, Twitter, Apple) have changed. For each company, I plotted the percentage of posts with the company’s name in the title, and also made a smoothed plot comparing all six at the end. Note that Microsoft and Yahoo seem to be trending slightly downward, and Apple seems to be trending upward.



 

Mentions of Microsoft



 

Mentions of Yahoo



 

Mentions of Google



 

Mentions of Facebook



 

Mentions of Twitter



 

Mentions of Apple



 

All Trends


 

Source: Hacker News Analysis


Consulente in Informatica dal 1984

Software automazione, progettazione elettronica, computer vision, intelligenza artificiale, IoT, sicurezza informatica, tecnologie di sicurezza militare, SIGINT. 

Facebook:https://www.facebook.com/flaviobernardotti58
Twitter : https://www.twitter.com/Flavio58

Cell:  +39 366 3416556

f.bernardotti@deeplearningitalia.eu

#deeplearning #computervision #embeddedboard #iot #ai

 

Related Topics

  Subject / Started by Replies Last post
0 Replies
100 Views
Last post March 30, 2018, 12:04:30 PM
by Marco1971
0 Replies
54 Views
Last post June 20, 2018, 08:33:03 AM
by Flavio58
0 Replies
58 Views
Last post June 20, 2018, 10:02:53 PM
by Flavio58
0 Replies
66 Views
Last post June 21, 2018, 06:05:16 AM
by Flavio58

Sitemap 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326