Litui.Net

Bereft of updates on happenings of the past year and being something of a copy-cat, I’ve decided to wrap up 2009 in a single post. I am, however, going to try not to duplicate events too much.

NYC

My pal Dave and I set for New York in May to take part in the celebration/memorial for the birthday of Frankie Manning. This was my first time in New York and it was definitely among the most amazing cities I’ve been to. The two of us stayed on 32nd and Broadway and spent the first few days of our trip exploring the city.

Manhattan was far more dense than I’m used to and built upward at heights that ensured my head was tilted back in true tourist fashion while walking down the street for most of my stay. I rode tour buses around both Manhattan and Brooklyn and hopped off and on at my convenience. I managed to take in Central Park, the Empire State Building, Times Square, Grand Central Station, and more. Dave and I even went to see Guys and Dolls with Oliver Platt and Lauren Graham on Broadway. I managed to take a few hours one day to explore Crown Heights in Brooklyn, home to a large population of Chasidic Jews. In Harlem, Dave and I found the Savoy Ballroom marker and enjoyed some amazing chicken.

The dancing portion of the trip was also fantastic. The event ran for almost 5 days. The primary venue was the Manhattan Center including both the Hammerstein Ballroom and Grand Ballroom. On the first full day there was a memorial service for Frankie followed by a second line to Central Park where we danced outdoors all afternoon. Other venues over the 5 days included panels with those who knew Frankie Manning over the years, dance workshops, tributes, competitions, and of course dances every evening.

I learned a lot about dance during my trip and had the opportunity to take instruction from some living legends like Chester Whitmore and Chazz Young. I met Norma Miller and had the opportunity to watch these and other masters dance. Most notable was the dance on stage one night between Chester and Dawn Hampton wherein the two demonstrated how enjoyable dancing could be without being overly complex or athletic. The two were having fun dancing.

While the event was about Frankie Manning and largely Lindy Hop, watching people dance (especially the older dancers in the scene) made it more clear to me than ever that dancing is just moving to the music and having fun with it. Going to workshops and studying moves and technique (as well as being such a beginner as I still consider myself) has made me over analytical about Lindy Hop. I decided then that I would work on rhythm and movement as basic elements independent of Lindy Hop and just have fun with social dancing.

Gaming

This year marked a return to gaming on a more regular basis. Jodie and I started playing World of Warcraft again in the first half of the hear though our interest has dwindled again recently. I became quite addicted to Fallout 3, and have more recently been ignoring it in favour of Dragon Age: Origins which is proving to be one of the best role playing games I’ve played in years.

A group of Calgary swing dancers got together several times to fight for freedom (and gold) and battle supernatural creatures in the Dungeons & Dragons 4th Edition universe. Our DM is running the War of the Burning Sky Campaign Saga. We’ve been playing infrequently but it’s been a good time. For someone as nerdy as I am, it’s odd that I’ve played so little D&D in the past. Finally my old dice (and some new ones) are being put to use. Hopefully things pick up this year.

Moving

In September I moved to a nice new apartment in another corner of downtown Calgary. Jodie is sharing the place with me. Aside from still missing some furniture, decorations and the like, we’ve settled in quite comfortably. One of the criteria we were looking for in an apartment was the potential to have a cat and this place fit the bill nicely. This year we’ll be filling in the missing bits.

Jodie

Because she’s also awesome. We’ve been together over a year now and don’t hate each other so I take that as a good sign. We went to Edmonton together this year and saw a number of concerts in Calgary including Dragonforce, Blue Man Group, and Video Games Live. I travelled with her to Ontario to meet her family over the holidays. Great people (and cat) and a nice trip on the whole.

Work

Things continue to go well at work. Busy as always and projects are varied. I have more responsibility these days and more opportunities to learn about interesting technology.

Computers

My 2.5 year old Macbook Pro has been flaking out for the past few months. I suspect it’s this issue and now have a case number assigned and a warranty exemption for service. All signs point to the video issue but I need to go to a service centre to confirm. It started as graphical corruption while playing WoW that would crash the software and cause system slowdowns. Now when the corruption occurs, it hangs the whole system and on reboot I get the multilingual kernel panic. I am only able to boot my system again after I repair my partition in Target Disk mode using a second system and reset the PRAM. I’ll be taking it in tomorrow most likely.

One of my co-workers submitted this help request today.  This issue was dealt with and everybody had a good chuckle, but it was too amusing not to post somewhere for others to share in the amusement.  Paraphrased anonymously here:

We have a Logitech wireless keyboard here, but found no wireless adapter to go with it.  Please send a new keyboard or an adapter for this one (see attached image).
- Anonymous Co-Worker

The amusing part should be evident within a few seconds of looking at the pic.

The company I work for, Cansel Survey Equipment runs a network of Trimble GPS base stations across Canada in multiple VRS configurations. This network (Can-Net) is powered on the backend by Trimble Infrastructure software. I’ve been integrating around this software for about 2 years now.

Integration and Abstraction

While performing admirably at its intended job (many of the details of which still elude me as I’m no geomatics engineer) the software can be a little monolithic. It works as advertised, make no mistake, but its UI is a bit clunky and it doesn’t seem to integrate well into other applications without a great deal of massaging. [Please Note: I say this with respect for the fact that the software is easily the best available for GPS/GNSS infrastructure and it does seem as though Trimble is making strides towards modernizing their applications.]

One of my main goals with regard to the infrastructure software has been (while working within and around the known limitations of the software) to abstract account management, reporting, and our internal tech support processes from staff access to the actual servers themselves. There are many reasons why this is necessary in an operation this size:

Automation

It can be very difficult for staff to manage sales and account terms in ERP software alongside user accounts in the GPS Infrastructure. Automation is necessary to ensure that customers are getting the accounts and access they paid for and freeloaders are kept out.

Accountability

Having user access to the database abstracted through a custom management tool means a greater level of logging of historic changes to user access tables and moderation of the types of changes that can be made.

Stability

More staff accessing the servers means a greater possibility of staff accidentally closing the server applications (much of the software runs windowed) and making problematic changes. These sorts of things can interrupt end-user access. Abstraction means greater regulation of what software runs on the servers and the resources used by that software.

Security

Giving direct access to staff invites unintended use. Since simply opening a web browser to a questionable page in Windows can result in virus/malware infection it’s important to keep the list of users with access to the actual servers to a minimum.

This necessity resulted in the ongoing programming of an intranet web application (written primarily in Ruby on Rails) which I may discuss in more detail in another post.

Bolt-ons

One of the roadblocks in the abstraction process has been the lack of useful real-time output from the infrastructure software for monitoring purposes. Access logging occurs only after a user logs off. This has made it necessary for our technical support to call the server admins to obtain information on whether or not a station is streaming data or a user is online. This is not ideal and for reasons stated above, it’s even less ideal to give them server access simply to check the online users list.

Bolt-on #1: Google Maps

While not my idea, this was a good choice for (near) real-time stationary station connectivity status.  Using Google Maps allows not only our staff, but all users and the general public (required by Google’s terms of use) the ability to check our station connectivity status.

My implementation uses protocols available in the infrastructure software to obtain a list of stations and logs that to a static file on a periodic basis. This allows me to place the file off the servers (better for security) as well as to provide a very quick-loading source of data for the Google map (the server’s own protocols for obtaining this data are insanely slow).

I have a plan to implement more up-to-date station statistics to our tech support staff using a means other than Google Maps, but more on that another time.

Bolt-on #2: Who’s Online?

As mentioned earlier, getting a list of the users currently connected to our system requires access to the server. In particular, access to the User Interface software for Trimble’s NTRIP Caster service. The UI provides usernames of connected users, amounts of data transferred, mountpoints (data streams), source IP addresses and source ports. Unfortunately, owing to the fact that many of our accounts have serialized alphanumeric usernames (an important part of our ERP integration) the username itself doesn’t tell us much about who is connected. Ideally, we need an approach that allows us to cross-reference the usernames with our ERP to provide customer associations and to view the list of users via a management tool running on a separate machine.

I’ve heard of some administrators using screen scraping utilities to provide this data to their customers. This method would require the GUI to be maximized and foremost on the screen at all times. Additionally, the data would be an image (unsortable, unfilterable and unusable for anything but display).

My method requires a little more diligence but results in the type of data and access we need:

The most important part of this method is the tool TShark, part of the Wireshark package. TShark and Wireshark are network packet analysis tools. They (with the help of passive packet capturing tools) can apply filters to network traffic in realtime and output specific information about the data. For this purpose, I set up TShark to run realtime analysis on the same system running the NTRIP Caster, monitor the same ports, filter out HTTP Authentication data (NTRIP is based on HTTP and uses basic auth) on those ports and produce log files of selected fields (namely: source IP, source port, and username/password).

I then wrote a script on a separate server that obtains these authentication log files, uses SNMP to obtain a list of source IPs and ports for current connections to the NTRIP caster, compares the IPs and ports to those in the log files, and loads the most recent matching usernames into an array. It then does some database magic to match the usernames to customers and outputs the result as a JSON file which can be parsed using libraries available in most programming languages. This script is run by Cron every minute.

Using an AJAX intranet web page that reloads and parses the JSON file every minute, I can provide a list of current users to our technical support staff that’s internal to our company network and does not require direct access to the servers.

[Edit: It should be noted that TShark chews up RAM pretty quickly.  I have it restarting on a daily basis so it doesn't eat all the system memory.  There are probably other tools that can do the job, or you could write a custom parser that's more efficient if that's a concern.  I chose TShark because it was the easiest solution to implement out-of-the-box.]

Oh, hello again blog.  It’s been awhile, hasn’t it?  I know I’ve been neglecting you and I can’t promise to be any better about it, but I’ll feed you some scraps and hopefully that will tide you over for awhile.

While writing this I’ve been obsessively pressing F12 to check on my UPS shipment of a Samsung NC10 netbook [update: just now arrived!  yummy!].  I’ll likely be installing an alternative OS of some sort on it.  Probably Ubuntu Linux, but if I decide to change out the wireless adapter I may take a stab at turning it into a Hackintosh.  I recently spent some time (and factually, am still spending time) converting my desktop system, Butlertron, over to OS X.  Miraculously, it mostly works with only a few issues (occasional kernel panics on SATA controller).  It reminds me of all the effort I had to put into getting Linux working on my hardware back in the late ’90s.

Work at Cansel continues to go swimmingly.  I’m getting closer to the end of my third year of employment here (July) and looking back I can’t believe how much I’ve learned and accomplished here so far.  It’s not all fun and games, but it’s often stimulating and I feel the work I do is appreciated.  Work is still sending me traveling quite frequently.  In December, my boss and I traveled together to both Vancouver and Toronto to bring Global CADD Systems into the company fold.  Next week I’ll be going to St. John’s, Newfoundland to visit our new branch at MF Kelly.  Later in the week, I’ll be visiting our Halifax (Dartmouth) branch.  I also have several major projects due within a month.  Busy times.

I’ve been doing a lot of programming lately and I’m actually starting to feel like a programmer.  Those who know me will likely be rolling their eyes at this point, but it’s true that I rarely consider myself a programmer by nature.  I still feel insecure about the quality of my programming, but it’s finally getting to the point where I can pretty well sit down and write up whatever I need for the purpose in any of a handful of languages.  That’s a pretty nice feeling.

I continue to swing dance and will be in attendance at Frankie Manning’s 95th Birthday Party in New York in May.  This will be my first trip to New York as well so expect some crappy pics of Lady Liberty and the Empire State Building to surface a couple months from now.  In the more immediate future I’ll be attending 9PLEX A.K.A.: PLEX and the City here in Calgary.  This coming Friday and Saturday nights there will be dances with the Bow Djangos and the Polyjesters, respectively.  Both are very fast bands and I’ve been working hard at improving my Balboa accordingly.

This year I also introduced my girlfriend to Lindy Hop and she seems to be enjoying herself though she lacks the time in her busy school schedule to take dance classes at present.  Oh yes, I have a girlfriend named Jodie who makes me very happy. ♥