cliserver_rust: Learning Rust by reimplementing cliserver with Tokio

Jan 26th, 2017 9:59 pm – Mike Bourgeous

Lately I’ve been reading about the Rust programming language, just for fun. One of the ways I (and others) enjoy learning a new language or framework is porting an old project into the new language, while trying to take advantage of the language’s features.

So to learn Rust, I’ll be reimplementing my old cliserver example for libevent using Rust’s Tokio crate. At the risk of public embarrassment, I will be tracking my progress using GitHub issues.

Ruby Gems for home automation: nlhue and xap_ruby

Jan 5th, 2017 5:17 pm – Mike Bourgeous

The web interfaces for the Nitrogen Logic depth and automation controllers are written in Ruby. To talk to the Philips Hue lighting system and some other DIY home automation systems, I created two Ruby libraries, nlhue and xap_ruby. I recently converted these libraries to Ruby Gems available from RubyGems.org.

Both of them depend on EventMachine for fast network event handling, but that also makes them a bit difficult to use. They were developed in a bit of a hurry, follow C rather than Ruby indentation, lack automated tests, and don’t represent the best code quality. Nevertheless they have been battle tested in real products working well for real people, and they may yet be useful.

Continue reading for more information about these gems.

MSSQL MERGE/UPSERT with Ruby and the Sequel gem

Dec 14th, 2016 1:06 am – Mike Bourgeous

My last post contained some code snippets useful for working with an Oracle database from Ruby. I’ve also had to interface with Microsoft’s SQL Server database (to add data to a data warehouse) using Ruby and Sequel. Here’s a snippet for using the MERGE statement with the Sequel gem, useful unless/until Sequel gets official MERGE support. This snippet only supports basic UPSERT functionality, where data is updated when the key is matched, inserted when not matched. It does support multi-column keys for matching.

# Code to perform a basic update/insert using MERGE. Tested with MSSQL # and the TinyTDS adapter. Assumes DB contains a Sequel::Database. require 'sequel' module Merge # Returns a Sequel::Dataset that will update or insert the given Array of # Hashes of +data+ into the given named +table+, with the given primary # +key+(s). Hash key names in +data+ must match the table's column names # The dataset will return one row for each row that was inserted or updated, # with the action performed in the :$action column. # # Examples: # Merge.merge( # :schema1__table1, # :col1, # [{col1: 1, col2: 2, col3: 3}, ...] # ).all # # => [{ :$action => 'UPDATE', :line_id => 1 }, ...] # # Merge.merge( # :schema2__table2, # [:col1, :col2], # [{col1: 1, col2: 2, col3: 3}, ...] # ).all # # => [{ :$action => 'INSERT', :col1 => 1, :col2 => 2 }, ...] def self.merge(table, key, data) raise 'No data given' if data.empty? || data.first.empty? # Ensure consistent column order cols = data.first.keys values = data.map{|h| cols.map{|k| h[k] } } key = [key] unless key.is_a?(Array) key_sql = (['? = ?'] * key.size).join(' AND ') key_params = key.map{|k| [Sequel.qualify(:target, k), Sequel.qualify(:source, k)] }.flatten update_cols = (cols - key) update_sql = (['? = ?'] * update_cols.size).join(', ') update_params = update_cols.map{|k| [Sequel.qualify(:target, k), Sequel.qualify(:source, k)] }.flatten sql = <<-SQL MERGE INTO ? AS ? USING (VALUES #{(['?'] * values.size).join(', ')} ) AS ? ? ON #{key_sql} WHEN MATCHED THEN UPDATE SET #{update_sql} WHEN NOT MATCHED THEN INSERT ? VALUES ? OUTPUT $action, #{(['?'] * key.size).join(', ')} ; SQL DB[ sql, table, :target, *values, :source, cols, *key_params, *update_params, cols, cols.map{|k| Sequel.qualify(:source, k) }, *key.map{|k| Sequel.qualify(:source, k) }, ] end end

The code builds the SQL dynamically since it has to insert a different number of parameters based on how many columns are being updated or used as keys.

Make sure you read the code comments from the snippet. Also make sure you’ve read up on how the Sequel gem qualifies schema, table, and column names using double- and triple-underscore.

You’ll need the following gems:

Interfacing Legacy Oracle PL/SQL and Modern Ruby Code

Dec 13th, 2016 7:39 pm – Mike Bourgeous

My last couple of blog posts have been about the backend and middleware work I did at my previous employer. I wrote about two Ruby gems, ClassyHash and HashFormer, that help with data validation and transformation in backend APIs and in middleware. Today we’ll look briefly at some code snippets to help Ruby developers interface with older systems that were written in Oracle PL/SQL, possibly using Oracle applications like EBS (E-Business Suite).

To help launch my previous employer’s updated site, I kind of dove head-first into the deep end of PL/SQL, teaching myself the PL/SQL language, refactoring thousands of lines of legacy code that was not designed with maintenance in mind, and learning chunks of Oracle EBS (both the arcane UI and the even more arcane internal PL/SQL interfaces) over a period of several months. Let my pain be your gain. Continue reading for essential gems, some tips and tricks, and a wrapper script to make the sqlplus command-line interface a little nicer for Ruby developers.

Hashformer: Transform data in Ruby

Nov 22nd, 2016 9:03 pm – Mike Bourgeous

Let me tell you about Hashformer, another open source Ruby Gem I wrote for my previous employer. Like ClassyHash, Hashformer was written as part of the “middleware” interface between a Solidus ecommerce site and an Oracle E-business Suite backend. Hashformer defines a Ruby DSL for basic data transformations, like renaming keys, merging values, etc.

Hashformer is a bit more niche than ClassyHash — most projects probably wouldn’t have a use for it, but when you need it, you need it. It’s similar in spirit to that old four-letter word, XSLT, but simpler and Ruby-centric. Read on for an example.

Data validation in Ruby with ClassyHash

Nov 16th, 2016 6:33 pm – Mike Bourgeous

In this post I will briefly demonstrate the ClassyHash gem, which is a fast data validation gem written in pure Ruby. I recently released version 0.2.0 of ClassyHash, with some cool PRs integrated and quite a few new features. Here’s a quick example:

schema = {
  query: Set.new('repo', 'user'), # Match either 'repo' or 'user'
  values: [[String]], # Match an array of zero or more Strings
}
data = {
  query: 'repo',
  values: ['classy_hash', 'hashformer'],
}
CH.validate(data, schema) # Returns true if the data is valid, raises an error if not

Continue reading to learn about ClassyHash’s history and see a basic ClassyHash validation tutorial.

Resurrecting a dinosaur: the iBIZ KeySync keyboard for Pocket PC

Nov 9th, 2016 7:02 pm – Mike Bourgeous

Several years ago I came across a number of obsolete Pocket PC handhelds and accessories at a surplus sale. While the PocketPCs themselves weren’t worth keeping due to the dead batteries and slow processors, I held onto a compact portable keyboard with a 9-pin serial connector made by a company called iBIZ. I’m finally getting around to hooking the keyboard up and seeing if I can get it to work. In this post I’ll document the process of connecting to the iBIZ KeySync keyboard and decoding its protocol.

New Blog Theme

Oct 28th, 2016 6:09 pm – Mike Bourgeous

If you’ve come to my blog before, you may have noticed there’s now a new site design. While Octopress is still awesome, my previous Octopress-based blog theme wasn’t a good match for the new design of my main site. This updated design, using Bootstrap with some customizations, pays homage to the original Octopress layout, but provides a more modern look and feel.

I’m a desktop first kind of guy, and even I love the new theme on my mobile devices. I think you will too. Continue reading to see a side-by-side comparison of the old and new styles, and to see some of the other new tricks of the upgraded theme.

RailsConf 2014 Lightning Talk Slides - Failures of Distributed Systems

Jun 10th, 2014 2:05 am – Mike Bourgeous

I’ve been doing a lot of Ruby on Rails development lately, and this year I had the privilege of attending RailsConf 2014. DHH created a bit of a stir when he declared TDD obsolete and dubbed us all software writers, and several of the sessions were related to distributed systems and service-oriented architectures.

As such, I was motivated to give a presentation during the “open mic” lightning talks session about the failures of distributed systems, and how software writers can use some engineering techniques to survive these failures. After much delay, I’m finally uploading my hastily prepared slides (with one minor grammatical correction).

Important bug fix in Depth Camera Controller firmware build 62

Mar 28th, 2014 6:53 pm – Mike Bourgeous

I’ve released a new version of the Depth Camera Controller firmware that should fix a nasty bug affecting certain newer models of Kinect for Xbox 360 and Kinect for Windows sensors. This bug caused those particular sensor models to display a “Camera Offline” error. Though controllers attached to these newer sensors still do not have 100% of the compatibility of the original Kinect for Xbox 360, they should provide fully functional depth and brightness sensing.

blog.MikeBourgeous

Making life more livable through technology