Skip to content

Setting variables across tasks in capistrano

I am learning to love capistrano–it’s a fantastic deployment system for remote server management.  I’m even learning enough ruby to be dangerous.

One of the issues I ran into was I wanted to set a variable in one task and use it in another (or, more likely, in more than one other task).  I couldn’t find any examples of how to do this online, so here’s how I did it:

task :set_var
self[:myvar]= localvar
end

task :read_var
puts self[:myvar]
end

Note that myvar and localvar need to be different identifiers–“local variables take precedence”.  Also, the variable can be anything, I think.  I use this method to create an array in one task, then iterate over it in another.

[tags]capistrano, remote deployment, ruby newbie[/tags]

Cloud Computing Tips Web Applications | moore |

New Release of GWT Crypto Library

I just released a new version of gwt-crypto.  You can download it here.  While encryption in javascript has its limits, it also has its place.  Currently, I am using it for some data (lat/lng) that we want to be obscured, but is not top secret.

If you’re using this library, please let me know what you’ve found it useful for.
Overall, this has been a fun experience.  I’ve learned at least the basics of maven, had some interaction with users and written tests for bugs they file.  (I got involved in this project earlier this summer, because I contacted the maintainer.)
[tags]encryption, tripledes, gwt,open source[/tags]

GWT Java | moore |

Boco: Colorado’s SXSW?

I spent yesterday at boco.me, a one day, one track conference in Boulder Colorado. The focus was on three different areas: food, tech, and music.  Apparently, South by Southwest (SXSW) has a similar multidimensional focus.

I was looking forward to meeting people from different spheres with different interests, and it certainly delivered that. Most attendees I talked to were tech people, however. Many thanks to Andrew Hyde and company for organizing this. I hope it’s the first of many.

Before signing up and actually before the conference, I did not have a very good idea of how much I was getting.  It was actually quite affordable: $99. For this modest price, attendees received:

  • entry to a concert: value $15
  • $30 worth of dinner at one of Boulder’s many fine restaurants
  • happy hour with beer and wine and apps
  • three sessions with about six speakers per session
  • three breakout sessions
  • a free T-shirt
  • a thank you note from Andrew(!)

Boco was, to put it mildly, a hell of a deal.

The conference had, as first year conferences tend to, a few flaws. The things I would change were:

  • allow users to ask questions of the speakers
  • have the breakout sessions be a bit more organized–they felt very ad hoc.

What follows are my notes from yesterday.  Here’s what the Daily Camera had to say.

First up was Rachel Weidinger (her slides are here). She mentioned the “big here and long now” and talked about tools that make our here bigger–“handheld awesome detectors”.  The tool that excited me the most was the Good Guide. This site offers what I’ve been looking for for a long time, which is detailed information on products, so that price and marketing are not the sole guides when you purchase something off the cuff. This guide has an API so that third-party developers can access their data. Oh, and Rachel is also looking for someone to build snake detecting goggles.

Next, Mark Menagh spoke on the differences between eating organic and eating locally.  I paraphrase, but he said that folks who eat organics are pessimists who want rules to prevent bad things from happening to their food and locavores are optimists.  He also emphasized that this November, Boulder voters are going to be asked to extend the Open Space sales tax ( till 2034! [pdf]) and that while we do that, voters should let the county commissioners know how they feel about GMO crops on open space land.

Then, Justin Perkins, from Olomomo Nut Company discussed some of the similarities he had noticed between building a band fanbase, as he did in the 1990s, and building one for a local food company, as he is doing now.  I can tell you from experience that his nut products are quite good.  He talked about engaging users in the product so that they feel it’s part of their story. Takeaway quote: entrepreneurs “have to be consistent and persistent as hell”.

Cindy O’Keeffe spoke about her experience fighting the GMO beets on Boulder County Open Space land.  I had heard about this issue before (Mark also discussed it), but she gave a good overview of the issues, and she had a compelling story about her personal journey from detached global environmentalist to local leader opposing the GMO planting.

Rick Levine, an author of the Cluetrain Manifesto (read it if you haven’t!) and now chocolatier, gave an overview of the Cluetrain ideas, and then talked about his new venture into high end chocolates, including some of the physics of chocolate.  Seth Ellis, his company, have shiny candy bar wrappers that he claimed were home compostable.  When talking about the Cluetrain and his experiences in technology, he offered up the observation that while he had been really interested in technology, his really great moments were talking to people.

The Autumn Film, a two person Boulder band, talked a bit about their experiences in music creation at this time.  Takeaway: music used to be “work hard, get lucky, hit it big”, but the industry changes have now just made it “work hard, hit it big, work harder”.  You can check out some of their music for free (well, you have to give them some of your personal information). Then, one member of the band performed.

I enjoyed the first breakout in which five of us gathered outside and discussed a wide variety of topics.  It was great to have a framework for getting to know the other conference participants.

Amber Case led off the second session by talking about cyborg anthropology–basically the idea that humans extend themselves via their tools, and that the malleability of current tools (think iphone) far exceeds the malleability of previous tools (think hammer).  Several of the other attendees found her ideas fascinating, but I wasn’t as astonished.  I guess I have thought about this topic, though certainly not with the rigor that Amber has.  (reading Snow Crash is no thesis.)  She did have some neat pointers to other work going on in this field: human-blender ‘communication’ and hug storage. Humorously, her email sig reads “Sent from my external proesthetic device“

Rich Grote and Dave Angulo then talked about what makes an online influencer–relevance, audience, access and one other thing I forgot to write down.  They are working on a company, which I was unable to find a link to, to leverage online influencers for marketing purposes.  It reminded me a bit of what Lijit presented on in June at the BDNT.  They also talked a bit about Dunbar’s number, which is the “theoretical cognitive limit to the number of people with whom one can maintain stable social relationships”.

Scott Andreas discussed his experiences building social software for non profits.  The takeaway for me was that when you have a cohesive group and you provide them social software, it can enrich the community.  The most important thing is that the community (and their norms) exists and is enforced outside of the software.  He also talked about Sunlight Labs, an open data source about the US government. Also, Andrew Hyde mentioned at this time the idea of floating your revenue through Kiva.  I certainly am not earning a lot of interest on my business savings right now, and using the funds to do microloans could be a great social good.  I would be a bit concerned about loan losses, though (98% loan repayment is a bit worrisome).

Sean Porter of Gigbot gave a breakdown of the live music industry ecosystem.  There’s a lot of middlemen between the fan and the band when it comes to concerts–ticketing agencies, promoters, management.  He started down the path of explaining how much of the ticket price you and I pay each of these folks get, but didn’t go all the way; if he had, I think his presentation would have been much stronger.

Ingrid Alongi talked about how she learned about work life balance, and techniques for maintaining it.  Good ideas in there–having a status meeting with coworkers while on a bike ride was probably my favorite, though.  Incidentally, she was laid off on Monday and had found a new job by the time she talked on Friday

Grant Blakeman and Reid Phillips (the latter being a member of The Autumn Film) talked about the new music business models.  Takeaway quote: “things always change”.  Sounds like Abe Lincoln. They are building tools that allow musicians to use some new media to market and connect with their fans. I enjoyed their insistence on musicians retaining control of their work, and using new technology to facilitate that.  It reminded me of this great article by Joel Spolsky where he talks about how your business should never outsource core business functions.  Fan interaction seems a pretty core part of the band business, so I doubt it should be outsourced.

Ari Newman of Filtrbox talked about the realtime web: how we’ve reached a technology tipping point and that Twitter and its open API pushed the real time web into the forefront, but that it is larger than the Twitterstream.  Ari also mentioned how the real time web actually isn’t all that real time–even if the technology delivers news to your computer in half a second, if it is not in front of you, it doesn’t matter.  Maybe he should collaborate with Amber on some goggles that would push realtime news to you all the time 🙂 .  He had real neat slide effects, too.  I chatted with him a bit and it was great to hear stories of his old sysadmin days–Linux on a Mac 8500!

The second breakout session was over lunch.  Was really interesting to talk with Ryan and Angie of Location 3, a Denver interactive agency, as well as Andrew Hyde, Ef, Rahoul(sp?) and Dan Kohler; wide ranging discussion and not too focused.

The third set of sessions was more informal.  Half of the speakers did not follow their topics on the program…

First, Emily Olson, from Foodzie, discussed how she had turned her passion (food) into a job (Foodzie, among others).  Her main points: pay attention to what you do in your free time–that’s an indication of your passion; find a mentor; be willing to work for free, especially at first; don’t try to find the one true vocation.

Dan Kohler, of Renegade Kitchen, discussed how to not have your blog/website suck.  He had 3 people up on stage read 3 different posts, and critiqued them.  Takeaway–“put your voice into” your blog.  I have a pretty vanilla voice on this blog, but part of that is due to professional concerns; however, Dan made the point that really, if you do drive some people off with the tone of your blog, the people you have left will be fiercer fans.

There was a panel on where the local music scene was heading, moderated by Sharon Glassman, a local bluegrass musician, and featuring Jason Bradley and Ira Leibtag.  I stepped out during this panel, but I do remember Jason Bradly discussing how “lots of people live in a box” in reference to his bringing an accordion to a bluegrass jam (and the reaction of the other players).

Brad Feld discussed the startup visa movement.  The idea is anyone who wants to move to the United States and start a company would get a 2 year visa; it would be automatically renewable for achieving certain goals (raising more funding, employing a certain number of people).  The founder would have to show proof of funding.  More information here.  I like anything that gets more smart folks to move to the USA.

Elana Amsterdam spoke on her experience turning a blog she wrote into a recipe book, and stated that her experience showed how you could really build a full fledged business out of a blog, using your passion and the blog as a platform to publish.  She also recommended “Write the Perfect Book Proposal” by Jeff Herman.  Updated 10/4: I asked a friend in the book publishing business about this book and she said: “Yikes. Any book that says “it’s easier to get published than you think” makes me want to hurt myself. Proposals aren’t about capturing a publisher’s attention. They’re about showing your expertise, your marketability, and just plain having an idea that fits within what a company actually publishes.”  For what that’s worth…  I think that she’s absolutely correct, for certain kinds of blogs.  I know that Eric Sink did the same thing with “Eric Sink on the Business of Software”, a fine book that has a collection of blog posts at its core.

Finally, Lilly Allison, a personal chef, spoke about eating seasonally and consciously.  She is using the web to extend her reach (and her brand!) as a personal chef–if you sign up, she’ll send you meal weekly plans with in season menus.  I signed up and will let you know how it goes—I do have lots of food from my CSA (here’s a list of Colorado CSAs).

There was a third breakout session, but I had to run some errands, so I missed it.

Then, it was happy hour time.  Off to the Boulder Digital Works, above Brasserie 1010.  It’s a beautiful space in downtown Boulder, and I talked with some of the incoming students who are doing the first 60 week advertising certificate.  In addition I had conversations on a variety of topics from the success of boco to how to scale a custom chocolate business to whether presenting at BDNT helped business (answer, indirectly, yes) to what to do with consulting requests that interfere with your core business (with the Occipital folks)

At the end of happy hour, we gathered into groups of four.  I had dinner with with Scott Andreas, Dan Kohler, and Jen Myronuk; a fine meal at Centro and then to a concert at the Boulder Theater: Paper Bird.

All in all, a fantastic conference.  It was eclectic and not as focused as other conferences I’ve been to, but for that reason alone has value.  I get bored if I only educate myself in one dimension.  Thanks again to the boco team, and here’s hoping that next year is as good, if not better.

Business Conferences Social Media Technology and Society | moore |

“Blending Social Media with Traditional Marketing” Presentation

I have some interest in social media–I obviously blog, but I also have a twitter account as well as some other ‘social media’ interaction.  It’s also the reason I attend the Boulder New Media Breakfast.  One of the ways I keep up to date on topics of interest is using Google Alerts (it’s not just for Craigslist).  I also use FiltrBox, mostly because I have some friends who work there.

The FiltrBox folks are having a 1 hour webinar tomorrow titled “Blending Social Media with Traditional Marketing” which looks to be pretty interesting.  From the description, they’ll discuss:

how social media marketing and traditional marketing integrate, how your company can leverage social media, along with best practices, how to listen, monitor, engage and interact, with highlights of specific case studies.

Not sure how much marketing material you might get from signing up, but you can always use a throwaway email address.

Presentations Social Media | moore |

Denver BDNT Sep 2009

I helped Brian Timoney, of the Timoney Group present last night at the Boulder Denver New Tech Meetup.  It was my second experience presenting at BDNT.  (I presented in Jan of 2008 on GWT.)  But it was my first time at BDNT Denver–down at the Tivoli.

Co-presenting is always different than presenting alone.  I actually had a pretty small role in the presentation–I mostly just drove the demo (underwater navigation with Google Earth to visualize sonar coverage data–it’s very cool, but I don’t feel comfortable putting the demo login up–contact me if you want to see it).  I worked with Brian on the presentation format.  Brian has deep knowledge of GIS concepts (he recently ran a workshop at GIS In the Rockies), but he’s used to having more time to cover concepts, and 5 minutes just enforces a certain brevity.

We had a mentor–Josh Fraser of EventVue took some time to run through our presentation with us.  It was really great to have a third party, especially one in tune with the BDNT, give us feedback.  As I told Robert Reich last night, we went into the mentoring session with one presentation, and left with an entirely different one.  If you’re thinking about presenting at BDNT, please get a mentor (and you might have to ping the organizers a few times to get one–we did).

If I ever present at BDNT again, I’ll follow the format we arrived at:

  • 15 sec intro
  • 1 min talking about problem
  • 2-3 min demoing software solving problem
  • wrap up
  • contact info on screen during questions

However, one of the difficulties in presenting for 5 minutes to a varied audience is that it is hard to know what knowledge to assume (about, say, GIS).  I talked to some people after the presentation, and it seemed like we assumed our exposition of the problem was better than it actually was.  I guess one way to address that would be to have a 30 sec intro spiel that you could deliver or not deliver based on a show of hands.  Not sure if there are other ways to deal with this issue.

Finally, we were the only formal presentation last night.  It sounds like BDNT Denver isn’t as supported by the community as BDNT Boulder, in terms of participation.  I hope it doesn’t end–so, if you’re in Denver, consider attending this meetup–it’s a great place to network and get excited about tech.  Here’s the calendar of meetups.

Instead of other presentations, we went unconference style, a la BarCamp.  People broke into 5 groups and discussed a tech issue (personalization, structured data, real time web) in detail for 10-15 minutes.  Then someone from each group presented 1-3 minutes.  The twitter feedback seemed pretty favorable.  I like BarCamp formats, and enjoyed the change.  I found that everyone in my group had lots to say about personalization, including some pretty creepy personal storied about advertising on the net.  I believe someone was going to write up the resulting presentations–will link to it when I find it.

[tags]bdnt is the new barcamp?, denver, the timoney group, underwater visualization[/tags]

BarCamp GIS New Tech Meetup Presentations | moore |

Amazon AMI search

It’s interesting to me that there is no Amazon Machine Image (AMI) search.  AMIs are virtual machine images that you can run on EC2, Amazon’s cloud computing offering.  Sure, you can browse the list of AMIs, but that doesn’t really help.  Finding an image seems to be haphazard, via a google search (how I found this alfresco image) or via the community around a product on an image (like this image for pressflow, a high performance drupal).

I’m not the only person with this complaint.  The Amazon EC2 API only provides limited data about various images, but surely some kind of search mechanism wouldn’t be too hard to whip up, if only on the image owner and platform fields.

Does anyone know where this exists?  My current best solution for finding a specific AMI is to use the fantastic ElasticFox FireFox plugin and just search free form on the ‘Images’ tab.

[tags]amazon, ec2, can I get a ‘search search'[/tags]

Cloud Computing Web Applications | moore |

Samasource: Outsourcing as social enterprise

One of my clients (Twomile Heavy Industries) is building a large website.  He is involved in the non profit technology world (NTEN, CTNC, etc), and ran across Samasource, which is a social enterprise to bring outsourcing work into the developing world.  And not just Bangalore–they have work centers in refugee camps. They will be providing some testing services for this project.

Samasource offers a wide variety of services, all via screened partners.  I seem them as a cross between Odesk (which an interviewee touchs on here), Elance (which I joined, mostly to see what kind of jobs are available) and Kiva (which I learned about via Andrew Leonard).  See Samasource’s take on comparisons to Odesk and Elance in their FAQ.

What a great idea!  Very ‘the world is flat’.  This type of social enterprise overcomes my main objection to Kiva, because Samasource could provide a cost savings to their clients; compare that to Kiva, which provides no monetary return to lenders.

Anyhow, I’ll try to update when I’ve actually engaged with the folks that Samasource led us to, but it was such a cool business model I had to give them a shout out.

[tags]social enterprise, outsourcing, developing world[/tags]

Business Jobs Technology and Society | moore |

A survey of CDNs for use with Drupal

I have spent some time researching Content Delivery Networks (CDNs) and how they can integrate with Drupal.  Note that I have not yet implemented a CDN solution, so my experiences and opinion may change….  I will try to do a second post or update when we’ve actually rolled something out live.

Here are some criteria I’d use in selecting a drupal module for CDN management:

  • Do you need a CDN?  This is the key question, as a CDN can speed up your site, but introduces a layer of managment and expense that might not be worth the hassle.
  • Do you mind patching drupal core?  This might be a maintenance issue going forward.
  • Do you want to have just images on your CDN, or javascript and CSS as well?  What about video?
  • How contained within the drupal interface do you need your interactions with a CDN to be?  Are you comfortable using a third party tool sometimes?
  • Do you have an existing CDN to work with, or are you selecting a CDN from scratch?  Obviously, you have more flexibility in the second case.
  • Do you mind coding? Some of these modules seem like they are 75% of the solution, but you might need to write some code to finish things up.

There are a number of modules that attempt to integrate a CDN into Drupal, or might help doing so.  All of these had a release for Drupal6.

  • CDN: this seems like a great fit.  Active development, good sized issue queue, support for multiple CDNs.  It also patches core. Here’s a list of CDNs used with this module.
  • media_mover: this module seems like it might be useful if you were needing to move image and or video files to a CDN.  That might require some coding, although I remember there being some S3 and FTP support.
  • creeper: this module is all about Amazon API integration, including CloudFront.  Plus, what a great name!
  • parallel: fairly new module that changes the source hostnames of images, css files and javascript html tags.  Therefore, they can be served off a CDN, or another web server, etc.
  • storage_api: this is a general storage service with a CDN focus, but doesn’t appear to be well documented or supported as of this time.
  • cloudfront: adds Amazon CloudFront support to the imagecache module

These all seem to be useful in their own ways.  The current project I’m working on is already invested in the Amazon infrastructure, mainly because of Project Mercury, so cloudfront is our current choice.

Did I miss any key modules?

[tags]drupal cms, cdns rock[/tags]

Drupal PHP Web Applications | moore |

NearlyFreeSpeech.net: pay only for the hosting you use

I had a friend tell me about NearlyFreeSpeech.net. Much like Amazon’s cloud computing services, you only pay for what you use.  Unlike Amazon, there’s no complicated infrastructure or proprietary protocols to get familiar with.  I doubt it has the reliability and scalability of Amazon either.

The pricing is pretty crazy: a penny a day for a website, $1/GB for your first GB of transfer, etc.  There’s a calculator to give you an idea of what you’d pay.

For a certain type of user, who my ‘web presence in two hours’ method just won’t work for, and who can use time in lieu of money, this seems like a great solution. I’m thinking, for example, of non-profits that are just trying to get a web presence and who don’t want to use one of the blog sites for reasons of design control.  If all you have is a static site, this can be very affordable:

“Static sites don’t have any baseline charges at all; you pay only for the storage and bandwidth you use, making them incredibly affordable if you’re on a limited budget and you’re working with a prebuilt website like those produced by many of the most popular web design programs.”

I don’t have any idea what kind of support or uptime they offer, but I love the idea of hosting that might start at $3/month, but can scale up easily and transparently.  They’ve been around since 2002, so they must be doing something right.

[tags]hosting, don’t buy what you can’t afford[/tags]

Business Web Applications | moore |

Using APIs to move time entries from FreshBooks to Harvest

I recently was working for a client who has their own time tracking system–they use Harvest.  They want me to enter time that I work for them into that system–they want more insight into my time use than monthly invoice. However, I still use my own invoicing system, FreshBooks (more on that choice here) and will need to invoice them as well.  Before the days when APIs were common, or if either of these sites did not have an API, I would have had three, equally unsavory, choices:

  • Convince the client to use my system or at least access it for whatever data they needed
  • Send reports (spreadsheets) to the client from my system and let them process it
  • Enter my time in both places.  This option would have won, as I don’t like to inconvenience people who write me checks.

Luckily, both Harvest and FreshBooks provide APIs for time tracking (Harvest doco here, FreshBooks doco here). I was surprised at how similar the time tracking data formats were.  With the combination of curl, gnu date, sed, Perl and bash, I was able to write a small script (~80 lines) that

  • pulled down my time data for this client, for this week, from FreshBooks (note you have to enable API access to your account for this to work)
  • mapped it it from the FreshBooks format to the Harvest format
  • then posted it to Harvest.

A couple of caveats:

  • I still log in to Harvest to submit my time (I didn’t see a way to submit my time in the API documentation), but it’s a heck a lot easier to press one button and submit a weeks worth of time than to do double entry.
  • I used similar project and task codes in both systems (or, more accurately, I set up the FreshBooks tasks and projects to map to the Harvest ones, since FreshBooks is what I had control over).  That mapping was probably the most tedious part of writing the script.

You can view my script here, or at least a sanitized version thereof.  it took about an hour and a half to do this. Double entry might have been quicker in the short term, but now I’m not worried about entry mistakes, and submitting my time every week is easy!  I could also have used XSLT to transform from one data format to the other, but they were so similar it was easier just parse text.

[tags]getharvest,freshbooks,time tracking, process automation[/tags]

Business Dynamic Languages Programming Web Applications | moore |