#fullwidth #Logstash #Tech

Import lumberjack events manually with stdin

A typical install of logstash-forwarder (lumberjack) is configured to watch a set of files in specific locations and often playing with that file is impossible. However, you might need to load a file into it that it doesn’t typically monitor. In another situation, you may need to load historic logfiles into LSF. This can be problematic as LSF keeps track of its position in a given file and will often recognise the file as one it has already processed and won’t reimport events it considers as “old”. ...

#fullwidth #Life #Tech #TED

The curly fry conundrum on TED

Given the amount of data that we post about ourselves online – on Facebook, on Twitter, Tumblr, blogs, etc, the dataset that effectively describes you as an individual continually grows. With some clever analytics and sufficiently large sample size, trends can be inferred with alarming reliability and predictions about individual behaviour can be made with a frankly scary degree of accuracy. Jennifer Golbeck describes how scientists, governments and companies make use of this data to profile individuals and build a comprehensive picture of you based on seemingly unconnected events, actions and trends. ...

#fullwidth #Internet #Logstash #Tech #Tutorials

ELK Stack Retrospective

For the past six months or so, I’ve been running an ELK stack setup in our hosting infrastructure at work to monitor, among other things: HTTP requests coming in Nginx response times System loads Sendmail and Postfix activity Disk IO and related metrics To do this, I’ve had to evolve the infrastructure somewhat. Here’s a brief overview of what happened. v1 Logstash was installed on a single box using its built-in Elasticsearch server to store data. ...

#fullwidth #Games

Multiple Steam Library Folders

Steam, Valve’s content delivery network, games marketplace and cloud savefile storage system, among other things has supported having multiple install locations for your games library. As SSDs become more and more prevalent and cheaper, many people are looking to install their stuff on the much faster SSD. To create a new installation location for *future* installs – this article doesn’t cover moving your existing Steam library – simply open your Steam settings, hit the “Downloads” tab and click “Steam Library Folders” ...