Working with data in the UNIX shell
The UNIX shell is a useful environment to get work done. There're a number of standard, simple tools that talk to each other via a universal interface: the pipeline. This talk focuses on methods to manipulate and visualize data directly in the shell, without moving to specialized environments (numpy, matlab, etc). Specifically I will demonstrate and describe
feedgnuplot - a tool plot data coming in on STDIN
vnlog - a toolkit to read, write and manipulate columnar ASCII data
These are independent tools that are useful standalone, but with shell
piping are EXTRA useful together and in conjunction with other standard
UNIX tools. This unification of data processing and normal shell usage
enable powerful workflows that are otherwise unavailable.
Dima Kogan - Robotics Engineer, Jet Propulsion Laboratory
Dima is a long-time user and contributor to various Free Software projects. He lives in the shell inside Emacs on his Debian box, and is constantly looking for ways to save keystrokes. He plays with robotics tools during the day, and tries to give away as much of his work as possible.
About the SGVLUG
SGVLUG is one of the oldest and most active Linux User Groups in the Greater Los Angeles area. In addition to Linux, the group also shares interests in other free and open source software, all forms of technology, and the discussion of issues that arise with the these new tools, such as privacy rights. SGVLUG attracts members from throughout LA County including Pasadena, Glendale, Burbank, and eastward throughout the San Gabriel Valley. Our members include software developers, system administrators, hardware engineers, and software users of all levels of experience. Many work in the technology field as employees, contractors or consultants, and enjoy the learning and networking opportunities available from the group. We also have many members that serve as volunteers of their time and skills at various local events, including the annual Southern California Linux Expo (SCaLE).