Category Archives: internet

Backbone everywhere

internet, programming, ,

I finally put my newly built Node.js MVC stack on github! You can download it here: backbone-everywhere.

What’s so special about it? Here’s my list of exciting features:

  • Pages are rendered on the Node.js server by Backbone and jQuery.
  • All script resources are bundled by browserify and fileify,  uglified by uglify, and gzipped by connect-gzip for fast loading and deployment on other possible javascript environments.
  • The entire Backbone MVC stack works on the server, and is loaded in javascript enabled browsers to take over from there.
  • The app state is reflected in the url by means of HTML5’s pushState, or using hash notation when not supported.
  • The same app state is regained for non-javascript browsers pulling full requests from the server, so no worries about SEO!
  • All client / server communication is handled by socket.io (ajax is sooo 2009) and subscribed clients are updated with published models.
  • A JSON-RPC service listening to ‘/api’ requests, with an easy to build on service layer. Handy for non-web contexts such as mobile devices.
  • All data is persisted in Redis through an adaptation of mine of backbone-redis, enabling indexing, sorting and  foreign key lookups.

For me this is a whole new approach at engineering web applications, but I think I’ve managed to get a grip on it.
Not only that, it gave me a great impulse to reconnect with the pioneers of tomorrow. Because what I have done was build on top of the stuff from people with great vision.
Big shout out to the open source community, and the people willing and wanting to share. The sum of it’s parts will eventually overcome the current patent trolling paradigm.

What are you waiting for? Dig in!

Node.js is the future of web dev happening now

internet, programming, , ,

Having been a javascript fan since I started working with it a long time ago, I immediately fell in love with Node.js. Having discarded Jaxer earlier as too proprietary, even though it offered a solid mechanism for code reuse on the client, I have now adopted the uber active Node community.

You see, me and my partner decided to build a new and exciting community site/app (of which I have to keep the details secret for now). So when I started designing our new web 3.0 app with accompanying mobile app, I thought about and thoroughly  investigated the possible frameworks out there. We decide to build a single page application that would work in all javascript clients, and would gracefully degrade to server roundtrips when javascript was not available (but also to enable deep linking for SEO). I quickly decided to discard most PHP frameworks for our MVC setup. Not only because of the fact that those were mostly too bloated or complex, but also because it implied having to recode a lot of functionality for the client. Of course I also favor the stateful and event driven possibilities of javascript, so I made the paradigm shift and chose the Node javascript stack.

With all the Node modules out there it is finally possible to create a full MVC framework operating on the server as well as in the client, in the form of backbone.js with the help of bones (a Node backbone server implementation offering code reuse in the client).
And with the help of HTML5’s new pushState, we don’t have to worry about breaking Google’s need for deep linking. (Those looking for an example with gracefully degrading URL’s, take a look at the jquery address plugin.)
More goodies come in the form of the browserify module, enabling us to optimally pack all our resources for client side usage, even all our templates and other static files!

Some more info for those interested:

With regards to storage, we decided to go for Cassandra, since we expect a lot of writes, and a lot of scaling. In the mean time I am hoping somebody will come up with a nice abstraction on top of the new Cassandra CQL language, since there are already some Node modules out there working with it.

Taking sessions into account, I am currently favouring Redis, which also has a nice pubsub layer. But I haven’t investigated that path fully yet.

In the mean time I am working on an iphone demo in Appcelerator’s Titanium. Too bad it doesn’t support all the functionality we need on Android as well.

That’s all for now. I have to try and curb my enthusiasm, as all this goodness may come at the expense of my sanity due to sleep deprivation.

My love for Paypal just died a little.

internet, programming

After having put some days of work into creating my friends book site (iktami.com), I decided to keep it simple and implement Paypal’s “Add to cart” buttons.
Wrong choice.

You see, I was under the impression that Paypal’s shopping cart would be able to handle shipping cost based on weight. But no, it isn’t. Well, only if you’re a merchant residing in the US.

What? I thought computers and the internet would help bring an end to discrimination and suffering.

What could be the reason for this? I am sure it’s not a technical problem, because that little and simple piece of code is agnostic of location. And it isn’t money, because they would probably make even more if they didn’t piss off merchants outside the US.
Maybe they just don’t care anymore, having all that money, and getting (re)tired of it all.
Or, could it be some political hidden agenda? These things pop up everywhere these days.
I am probably missing something here.

Taking PHP development to the next level

internet, programming, , , ,

A lot of my enthusiasm for programming comes from my never ending interest in it’s evolution. I played with computers since I was 7, and already knew at age 13 that I wanted to become active one day in the ‘automating’ industry. I’ve always regarded programming as a trade or tool to automate repetitive tasks, but also to offload (error prone and inconsistent) people tasks to fool proof automated systems. I just wanted to make stuff easier and better, and found a way to do it.
I truly started my programming career in 1999 as a Java programmer in the corporate world, learning a lot about real world software problems. It made me realize a lot of things.
But even in the year 2000 internet applications were not widely recognized as “the way to go”. My employer, one of the best amongst Dutch knowledge engineering services, did not pay full attention to it yet.
So I left. I simply had to find out more about web technology, which I regarded as the future of software development.
I carefully chose to follow the ‘open source’ path (as opposed to the closed MS world), and divided the territory into “corporate vs fun and dynamic”. I ended up in PHP land.

But soon I found out about the drawbacks of PHP development. It’s a loose typed language, with a scattered user base, supporting all kinds of immature frameworks and libraries, for all the wrong reasons. Simply stated: PHP land was short on inhabitants with extensive knowledge of software development in general. After a while though, PHP was recognized for its RAD abilities, and more and more people with skills came into the game. This lead to a myriad in yet more frameworks and libraries, but now it was all about documentation, participation, and a growing user base. Because solutions were being reviewed, tested and explained, quality started to drift to the surface.

But how does one recognize quality in this field?
Since I have never studied software development on a university or such, I will always regard myself as a noob on matters that I have no experience with. I have learned everything by reading books, and from material on the internet. But because I was aways so insecure about my knowledge, and truly interested in what I was doing, I never stopped reading. That’s how I discovered that it’s most beneficial to start learning the industries’ best practices and ‘patterns’, before formulating your own suspicions and concepts regarding programming solutions. Building onwards from that premise I feel I have finally grasped an overall intuition for what matters most, and which choices should prevail others. Of course there is no holy grail of software design, but given a business goal, context and limiting factors, one surely can sketch a fruitful path for future development.
Do I bore you already?
The point is that I think that higher level principles should be considered first, when making choices in software development. Therefore I was always drawn to development platforms that obey such principles, even though some of their subsolutions are plain awful.
Steep learning curves and incomplete documentation were arguments very low on my choice break down list. As I have a brain, and a debugger, I’d rather work with beautiful flexible software than some simplifying framework caving me in and making me jump hoops to do the in-ordinary.
(Please don’t respond with PHP framework ‘showdown’ arguments, as I think Sheldmandu has a nice take on that, even though I don’t follow his simplistic view on ‘inheritance is key’.)

That’s why, about 4 years ago, I chose to go with the Zend Framework, being the most mature and offering so much of what I thought was important. It still forced me to do a lot of work by hand, and a lot of their code base seemed rather inconsistent. I think mainly because they let it grow too quickly without proper reviewing user contributed code base additions. And as a result of that, I think a lot of their solutions are simply not well thought out (like forms and data access).
But I loved their coding style, and the way they used naming conventions to get stuff rolling.

Then, about two years ago, I stumbled upon FLOW3, a new PHP framework built by the developers of TYPO3. In my opinion it will be the most advanced and productive PHP framework in the near future, but that has to be seen as it needs to become widely adopted. It has implemented a lot of the best practices from the Java scene (annotations, AOP, dependency injection). Which I think is a good thing, as that scene has been dealing with the largest chunk in complex software development for a long while.
I concluded that it needed a lot more time to come of age.

Around that same time I started using Magento for my own webstore (project was killed over a refuted business deal), and after that I worked freelance for 2 years with it’s complicated, yet powerful CMS abilities. A lot of 3rd party extensions built by novice Magento developers were indirectly compromising a lot of the projects I worked on (in the form of performance degrading or bug introducing plugins), thanks to Magento being too flexible and not understood well enough.
But Magento made me realise something:
What’s the use of a framework or library, if it doesn’t offer concrete reusable solutions to real world problems? In other words, why could I not find a development platform crafted on top of these high quality frameworks and libraries I so much admired?
Magento at least offered me out of the box configurable layouts, views, themes, multi site functionality….bla bla, etc etc.

Now that I wish to work on more versatile projects, preferably using out of the box, proven solutions, I have to check my facts again. I don’t want to go back and reinvent so many wheels. What are my options? What CMS can I use to not have to repeat myself too much for every similar project?
Let me write down some of my requirements:

  • An intelligent caching layer, like Magento’s, with it’s hole-punching capabilities.
  • An annotation-based domain persistence layer, using POPO’s (plain old php objects), decoupling data storage and making persistence trivial. (Doctrine 2 might fit these needs.)
  • An easy to setup service layer or domain API, enabling easier development of client-server architectures. Javascript, apps and flash are my main clients these days.
  • Straightforward creation of sites, templates and content, facilitating a multi disciplinary approach and separation of concerns.
  • Inheritance based themeing, allowing a stack of theme overrides, like Magento’s upcoming themeing system.
  • Plugin based architecture, preferably with a controlling mechanism warning developers about slow and impeding functionality.
  • Many great working plugins fitting my business needs!
  • Possibly some elaborate publishing mechanism, allowing for the entire application (files AND data please) to be pushed onwards in it’s development cycle: DEV / TEST / USER ACCEPTANCE / PRODUCTION
  • A large user base and developer involvement ensuring stable releases.
  • …

(Please feel free to add to this list)

Lately I found that FLOW3 is approaching it’s first stable release (possibly september 2011). But not only that, the release of TYPO3 v5 will be based upon FLOW3. So I quite hope TYPO3 to be the CMS I am looking for.

Group Messaging needs to grow up.

apps, internet, programming, ,

I recently developed the need for a real time group messaging system that allows the members to subscribe to topics and tags. Posting messages in such topics or including such tags would then result in a push notification to the subscribers mobile devices.
The admin of the group could create a taxonomy for the groups context, and members could contribute to the taxonomy, based on an approval system.
This allows for subscribers to carefully decide themselves what messages they want to receive, instead of somebody else deciding for them that they are interested in.

You see, because I hang out with a loosely organised group of artists, freelancers and randomly creative individuals, we need a tool to be able to mobilize each other, but only the people interested in the joint venture at that moment. So we want to create a list of topics/tags and locations to subscribe to. We want to keep informed of only what we subscribed to. The group is just too large to blindly spam everybody with every message.
And since we are often in the pre-organising fase, we simply want to be able to tweet a message including one of these tags to elicit interest and motivation to those possibly wanting to cooperate.
Not only that, sometimes we simply want to mobilize a group of individuals to meet at a certain location. Last minute spontaneous action.

Well, after doing some research I found some great and promising startups in the group messaging industry, as that industry is taking off like storm.
I really like the irc-like Convore, and posted my feature request there, but no answer yet. Too bad none of the tools I looked at (Beluga, GroupMe, Kik) offer what we need. Sure, there are some forum-like tools that send you an email when somebody posts in a thread, but none of these tools allows for subscribing to a taxonomy. Please correct me if I’m wrong.
I think most of these tools are truly helpful after the fact of organising structures. When all the roles are defined, the players are known, and from there it’s just a matter of communication and collaboration.
Not what we need.

So, because I am a programmer, and therefor lazy by nature, I want to appeal to the group messaging industry first. By asking them to incorporate such a mechanism in their platform, so I don’t have to build it myself.

Anybody?

1995 is here!

apps, gadgets, internet, kool apps, , , , , , ,

Did you read my previous post? 1995 is here. Well, almost. I can now listen to or view any track, video or stream I want, since I have added dTunes and PwnPlayer to my iPhone. They rock!

dTunes is an alternative to iTunes. It doesn’t support podcast downloading/viewing (iTunes does that well and for free anyway), but does offer:

  • torrent downloading with a webinterface defaulting to thepiratebay.org website;
  • a SeeqPod interface enabling almost all of their online functionality such as:
    • searching/discovering/browsing music/video:
    • downloading/streaming music or video files;
    • browsing my Podlists (SeeqPod’s online playlists). Problem is that it wont let me start playback of a playlist, nor let me create new Podlists. So I am left to downloading/streaming one track at a time. (And that suxx, so where’s the SeeqPod app?)
  • a TinyTube interface (providing PDA-screen optimized video’s from well known 3rd parties);
  • shake and play: turn the feature on and shake yer iPhone to let it play shuffled songs 🙂

How kool is that? But like I said, one problem is that it won’t allow me to create podlists , so I am tempted into downloading tracks for later organising (which I am trying to avoid). However, at other times you are likely to rip your own or somebody else’s cd’s. So you are bound to collect media files sooner or later anyway. And for that we have the PwnPlayer, which is an alternative to the original ‘iPod’ player. It does everything the iPod player does, plus:

  • filesystem browsing and playing;
  • on the fly playlist creation.

One problem with the PwnPlayer is that it’s not so easy to sync it with desktop music apps like RhythmBox. (I think there are ways, but it involves hacking xml files on yer iPhone.) I use AirSharing to move files to its public folder on its webdav server, and created a symlink to that AirSharing folder in my ~/Library/Music folder. I also created a link there to the downloads folder that dTunes uses: ~/Media/Downloads. So now I can listen to and organise my incoming files from within PwnPlayer (or MobileFinder for more file management options).

Looking Good, Feeling Fresh

apps, blogging, firefox, internet, kool apps, personal, , , ,

Yesss! I managed to put some time and effort into this blog and made it to my liking. Finally!

There are still some things I have to put up with for now, like the Flickr photo plugin behaving badly. It won’t consistently work with the lightbox module. If you click on one of my random pix it takes you to an HTML version of the gallery. Hmmm, time to override/add some event handlers then.

What constantly needs updating, are my favorite apps and open source section. Go check em out! I even made special sections for my apps:

I’ll try to keep them as updated as possible 🙂

Kohjinsha SR

gadgets, internet, kool apps, , , , , ,

Ok, I was in Japan..and had to get me one: the Kohjinsha SR. Of course I also ordered the 2 GB  mem upgrade, the large battery and the car charger.
I must say it’s rather sweet. The touchscreen especially has me panting. Installed some FF plugins like mouse gestures and the likes, and now it’s almost dashboard ready for my car :p. Almost. I just setup a XAMPP server to serve me a google maps page which updates every 4 seconds (thanks to the original post by Ryan Byrd). Now I am waiting for the next GpsBabel beta that supports my Qstarz BT1000 gps mouse. With a little mashing of google maps services I can drive around and see my personalised stuff be updated on the screen in real time :).

Update: the latest GpsBabel just came out, and I got my setup working aok! Darn slowness of my phones GPRS internet connection won’t handle the payload though 🙁

Something related that also needs mashing into my own project:

Google Calendar Map Generator

Songza: just music, no strings.

internet, kool apps, ,

Ha, very refreshing! Remember how most of todays online music services want you to install a client? Or want you to register? Or give you the impression that it might be tapping into a limited store of sponsored songs? Or are just too complex or trying to do too much?

Go check out Songza. It’s just a Plain Ol’ Website (with some smart scripting) that makes you search what you want and then play/playlist it with a clean friendly interface. I don’t say it looks that nice, but hey, I just wanna hear some music!

If you wonder where the songs are actually coming from, I checked under the hood: Youtube items are searched for, and only the audio is played. I wonder how much of those downloaded bits are actually used for music. Might not be such a good use of your bandwidth resources 😛 Also, if you are a quality freak, you might barf on some of the noise…

Anyway, try it while it’s online! The copyright lawyers might decide to take it down before turning to the real bad boy of the class: Youtube itself.

Under construction?

blogging, internet, personal, travel, ,

Btw, did I mention that I am working on this freshly installed/manipulated/upgraded/enhanced WordPress blog of mine? I am in love with her, and that means touching and feeling the lot of it. Don’t bug me about it, I just have to do this. She not only gives me butterflies, but also these delicious plugins that I have to devour. Wow, I can do so much now that I know her. It’s an empowering feeling. I take her as she is, but I have the feeling she will grow on me.

Yes Corine, you are fantastically wonderful too 🙂 But now I have to test drive this plugin that will geo tag my posts when we travel :p