We’ve been let down by the software industry. By now we should all be as comfortable with building and using everyday databases as we are with word processors and spreadsheets. There are many uses for them, but because the tools are too complex, we don’t bother. We satisfice.
FileMaker falls into the trap
FileMaker Pro is probably still the best-in-breed product for mom-and-pop data management. It’s a solid product, a product of integrity: fast, reliable and plays well with others. I have used it daily for over a decade for many purposes.
But FileMaker long ago fell into the classic innovator’s dilemma. They paid too much heed to their most vocal users, database developers. Database developers are not everyday people. They are technical and they need to build sophisticated solutions for their clients. They vociferously demand power, and are far more tolerant of complexities that stymie normal people.
By giving this vocal minority what it wants FileMaker neglected its roots: the everyday productivity worker — people like teachers, baseball coaches or small business owners. While the product got increasingly powerful, fundamentals that would have made the everyday user’s life better (such as a modern auto-complete data input controls or Google-like searching) were neglected. Thus a strong unmet need has been left behind for a competitor to come along.
Coulda Been Contenders
What other everyman database contenders are there? There’s Microsoft Access, written by and for developers. It sure ain’t a schoolteacher’s database. Access just took the old relational database mentality and built a desktop app around it. There was no new thinking about how normal people could and should go about managing and making sense of their data. Access has always been far behind FileMaker in simplicity despite the opportunity to learn from it and do better. Microsoft was going after a different audience: developersdevelopersdevelopers, again leaving normal people without a simple tool for their jobs.
Anything else? Microsoft Excel probably had the best shot at consumerizing database management. People use it as such and it actually is sufficient and flexible enough for many basic jobs. Excel even has some useful, well-hidden features to help you manage and understand your data (I’m thinking of conditional formatting and auto-filtering).
But a few features don’t a paradigm make. Excel never credibly broke beyond the paradigm of the VisiCalc spreadsheet. (That was a while ago; VisiCalc is a contemporary of Ms. PacMan.) Don’t get me wrong – spreadsheets are useful in their own right, and it probably wasn’t Excel’s destiny to become a true database. The point is, the holy grail of robust yet simple data management remains undiscovered.
(I should mention that if you are looking for a hosted database solution to use, check out Intuit’s QuickBase. It is a simple, flexible and well-established online database app giving FileMaker a run for its money.)
The Innovator’s Dilemma predicts that sooner or later someone will come along with a paradigm-busting innovation that renders the past thinking obsolete. I’m not sure this is it yet, but DabbleDB is bursting with new thinking. It should make the old skoolers think hard about how they are solving customer needs and what has been possible all the while, going back ten years, if only the problem had been looked at in a different way.
DabbleDB’s Innovations
DabbleDB is getting a lot of attention because of how it pushes the envelope on interactivity within a browser (need we say “Web 2.0“?). It is an exemplary role model for a desktop app-like experience. But it’s the thinking behind how users should be able to view and manipulate their data that excites me. Some examples:
- DabbleDB lets you flip between table view and grouped lists like it’s no big deal. This capability lets you group a list of names by profession, then by city then by company. In FileMaker you can only see grouped information as printable reports. You cannot edit or act on data in this view, an ancient limitation.
- DabbleDB allows ad-hoc changes to the data structure – especially in converting flat tables into relational structures so you can look at your data inside out. This type of conversion is a bear in FileMaker Pro, requiring that you set up tables, munge data, import multiple times and make sure things are connected.
- DabbleDB rethinks the balance between optimizing for fine-tuned control over layouts versus quick & dirty data analysis. FileMaker gives very fine control over layout. This control is no doubt needed in many realms but comes at a trade-off of convenience and speed. DabbleDB instead emphasizes letting you twist your data around until it makes sense, and then letting you save that view. It’s this ability for normal people to do ad-hoc data mining that is so badly needed.
- DabbleDB lets the user search across all fields Google-style. This is an everyday need that we’ve grown accustomed to thanks to search engines. It’s basic functionality in DabbleDB, but requires advanced techniques in FileMaker.
- DabbleDB attempts to pull off relational databases without invoking obtuse relational database theory. I’m not sure yet whether it succeeded. They may have just subbed in other concepts. For example what we know of as a table, they call a category.
- DabbleDB starts to integrate alternate data views, specifically a calendar view. If you have timestamped data, DabbleDB lets you view, filter, edit it in a calendar view like it’s no big deal. A calendar view is just the beginning though.
Let me see! Let me see!
It’s another disappointment that for the last fifteen years, in order to see your information you have needed to wrestle it into Excel’s charting feature.
I’d like to see a data visualization arms race with vendors competing on how well they can help you see — and therefore make sense of — your data. There is no reason why we shouldn’t be able to explore scatters, trends, correlations, distributions, maps, timelines and networks by poking a few buttons directly from the database environment. (There’s a vision to steal, by the way.) It’s not the data that matters as much as the insight gleaned from that data.
(Another vision to steal: Someone please create a solid timeline view of data for mapping out historical events or future plans. It’s hard for us humans to visualize chronologies. We’ve been without a mainstream tool to help with this forever.)
Tag, you’re it
Here’s a specific design to steal for everyday database products, including DabbleDB: Support tagging as a data type. Tagging is just a new name for the old concept of keywording, but it’s useful whenever you need to assign an indefinite number of categories to something, from a growable list of possibilities. (If you need examples, check out any blog or Flikr or Technorati.)
A tagging feature in an end-user database app would let end-users apply zero or more tags to a record, provide an efficient input UI that facilitates applying existing tags, let the user search against tags, and support adding new tags on the fly as an option.
The Big But
As interesting as DabbleDB is, I cannot imagine trading Filemaker in for it. DabbleDB and QuickBase are hosted web apps. This can be great if you need to collaborate with distant colleagues. But if you are just dealing with your own data there are some significant downsides. I wish there was a native desktop app version of DabbleDB. I’d be happy just to be able to run the DabbleDB web app on my personal laptop.
For more on the trade-offs between hosted versus local apps, see: hosted vs. local computing.
Meanwhile, here’s hoping that Filemaker, or another plucky upstart builds a new generation, desktop-based generalist database product.
Readers: If you know others involved in working on generalist databases, please forward this article. The URL is: http://stealthisidea.com/articles/dabbledb-thoughts/
Have you checked out Bento? It’s a greatly streamlined version of FIlemaker. Though I still don’t think that it has the data visualisation stuff.
The visualization page you reference in the post has moved. It’s new location is http://www.math.yorku.ca/SCS/Gallery/ and is definitely worth the click.