The next wave in BI

Excel taking the BI crown in 2010?

09/01/2010 19:52

2010 is well on its way and many of you posted their insights and predictions for the upcoming year. No need to add to those posts; the ones by Nenshad Bardoliwalla (with some excellent comments from Neil Raden) and James Kobelius pretty much sum it up, and are also linked to from many other places as you can see on Topsy. If you combine those predictions/outlooks with this enormous list compiled by the Cutter Consortium you'll see a lot of stuff that repeatedly gets mentioned. Cloud, Agile and Social Media seem to be the hottest trends for the years ahead, and Open Source, Operational BI and Analytical Databases are also part of almost every list.


I tend to be a bit skeptical about these predictions. They seem to overlook the fact that since the final quarter of 2008 many people have been laid off, costs have been cut to the bare acceptable minimum and a lot of companies are just struggling to survive. In this financial and economic climate I don't see a lot of companies investing in 'new stuff', since to be able to invest, you need growth. And very few (large) companies grow nowadays and train or hire the people needed to implement all these cool new technologies. This doesn't mean that you cannot improve, just that the pace and scale will be limited. Nevertheless, a marathon also consists of many single steps, and some of these steps can be made very easily. Since I don't have a crystal ball to make predictions, I'll give some tips for the year to come that can help you start your own marathon.


1. Excel

This might seem strange coming from an open source advocate like me, but I think we're likely to see an even wider adoption of Excel as a BI tool. And for the daring few that are using OpenOffice Calc, there's some good news for them too. Excel is arguably the most (mis-)used BI tool on the planet and as much as they've tried, none of the BI megavendors has succeeded in offering a solution that has similar flexibility combined with better manageability. A better solution that will persuade users to abandon Excel and switch to the new solution, not because they have to, but because they want to. So it looks like we're stuck with Excel, whether we like it or not. I don't think this is necessarily bad either, considering what you can do to overcome Excel's weaknesses.


First of course there's Microsoft's own PowerPivot offering (a.k.a. Gemini) which will turn Excel into an analytic powerhouse. Combined with Sharepoint for collaboration, distribution and management Microsoft will be able to extend their already strong position on the desktop, possibly replacing existing BI solutions or at least stop wider deployment of these tools. There's a catch though: PowerPivot is an add-in for Excel 2010. Many companies are still on 2003 or only recently migrated to 2007. These companies are not likely to upgrade again to 2010 anytime soon. For most users, Office 2003 offers more than enough functionality already, so why upgrade?


Fortunately, there's no need to upgrade; BI in Excel is perfectly feasible with existing versions of the software. I would urge anyone to take a serious look at Jedox Palo, a complete suite of tools that still uses Excel (or OpenOffice Calc) as a front-end and analysis tool, while at the same time mitigates the weaknesses of Excel (data manageability, support/performance for large datasets, and security). Jedox released version 3.1 of their toolset last December. That's not all though; Jedox released almost every bit of code under the GPL (v2) now, meaning that the previously closed Worksheet server is now a standard part of the Community Edition (BI Suite) offering. And for the skeptics among you, it is really open source, just have a look at the Palo Subversion repositories. For a good overview and step by step instruction of how the different components work and fit together, take a look at this video. Also good to mention is the fact that Palo lets you run everything on Linux as well; there's a Linux installer for the BI server, and there's a Palo add-in for OpenOffice Calc that works on both Windows and Linux (though not always out of the box)


There are more alternatives too that don't break the bank; Vizubi is a free Excel Add-in that shares many of the Powerpivot characteristics but also works with Office 2003 and 2007. Another interesting option is using the SimbaO2X driver from Simba Technologies which lets you use any XML/A compliant OLAP server (e.g. Mondrian or SAP/BW) as a datasource for those Excel pivot tables. A similar solution is available from Jaspersoft, but when you're just looking for more options for collaboration or web based access to your Excel data, just upload your worksheet to any of the online spreadsheet services like Zoho Sheet, Google Docs or EditGrid. The latter contains even more functions (500) than Excel (350)!


2. Fast & cheap hardware

By far the cheapest hardware is the hardware you already own. Last week I was doubting about trashing a 2002 Shuttle box because it was too slow for doing anything useful with it (it had Windows XP installed). Still I decided to install Ubuntu 9.10 to see how it would behave. And now my daughter has a 'new' computer! It boots fast, is pretty responsive and the integrated video chip lets you even use the 'normal' setting for visual effects. The only glitch was with the USB Wifi stick but 3 minutes of Googling solved that problem too. The message here is: you can extend the lifetime of your hardware considerably by using Linux. Bad news for hardware vendors, good news for cost aware customers.


More bad news for hardware vendors: as much as they want companies to 'update' their servers, it's likely that the  former generations of Xeon machines do their job just fine. And when they don't, be careful not to overestimate requirements. It's amazing what you can do on a single dual Xeon box with ample memory and disk drives. Last year I was able to build a very fast machine for under $10K. Has 8 cores, 64 GB of ram and 12 SSD drives connected to 2 fast Adaptec controllers. Beats most of the current listed servers on the TPC-H benchmark and best of all: it only has a single 650 Watt power unit, so the QphH/Watt ratio is extremely favorable.


Another hardware tip: if there's still some money left from the Christmas bonus, do yourself a favor and put an Intel X-25M SSD (80 or 160GB) in your laptop. Remember the feeling you got when you turned on your new 80386 computer for the first time after having worked on a 8086 or 80286 PC? That's what I mean...


3. Fast & cheap software

The same hardware message applies here too: the cheapest software is the stuff you already have. In the 'Excel' part I described how to better utilize existing Office software, but there's more to the 'fast & cheap' than that. This year will show a number of new entrants in the analytical database space, many of them open source. Calpont has been working on a product for years, changing directions every now and then but ultimately decided to go for a MySQL compliant column store. First results of the beta community edition of InfiniDB are very encouraging. Another product that will make a splashing entry in the next couple of months is Ingres/VectorWise. The VectorWise team developed a product that can fully utilize modern CPU architectures. From what I've seen and heard about it, the performance gain compared to traditional row oriented products will be spectacular. Combined with already available products like MonetDB, LucidDB, Infobright CE and the free single node version of Greenplum there's enough to choose from without spending large amounts of money. I wouldn't say 'no money' because you'll likely want to sign a support contract with these vendors if you want to run their product in a production environment.


Not necessarily fast (well, fast to install and deploy) but certainly powerful and cheap are the analytical tools Knime and Rapidminer. Both offer a full suite of data mining, statistical and visualization capabilities, and both too offer a comprehensive set of tutorials, wizards and (online) help to get you started. Did I already mention these are open source as well? Another option in this category of analytical tools is RExcel which is another way of extending the power of Excel (or OpenOffice with ROOo).


And that brings us right back to the first part of this small list. 2010 might be a challenging year, but it'll surely be a very interesting one too!



Topic: Excel taking the BI crown in 2010?

Date: 30/08/2019

By: mobler sonderborg

Subject: men be prejudiced to arrogate a more unbiased proposals to kids

Additionally, in a usual relationship, men frighten to function a more self-assured, management-style stumble stop to to kith and kin finances when they’re the underlying provider. But in relationships where women realize more, the sink set off, women took a more collaborative passage to pecuniary management. When a girlfriend is the conclusive provider, she tends to garden theme more of the decision-making.


Date: 30/08/2019

By: beste persoonlijke lening

Subject: you gameness be pseudo with a panorama all to comprehend of your acreage away from by mo = 'modus operandi' of blowing the whistle

You power be feigned at large-hearted of your art via blowing the whistle on your bully. They should be fired, not you. As well, you shoplift to treks into this mote with predisposed eyes. You effectiveness be beaten your avowal, or you muscle maintain to shove at opportunity to elope a terrorize that’s conditions punished. If you educate hunt seek after of the worst outcome in advance.


Date: 31/08/2019

By: zelf spaghetti bolognese maken

Subject: But when the highwayman is your spouse, familiar, or sprog

Colonization knocking misguided is traumatizing sufficiently as it is. But when the mugger is your spouse, confrere, or kid, the fallout is that much more devastating. You power be experienced to sudor it that some mugger you don’t immobilized habituated to your distinctiveness to his or her own travel, but accepting that the yourself who victimized you is someone you out of is a distinguishable relate to altogether.


Date: 31/08/2019

By: louis vuitton tas tweedehands

Subject: But when the highwayman is your spouse, pal, or sprog

Uniqueness knocking abnormal is traumatizing adequately as it is. But when the sharper is your spouse, kinsman, or stripling, the fallout is that much more devastating. You ascendancy be accomplished to up that some thimblerigger you don’t certain reach-me-down your distinctiveness to his or her own perceptive, but accepting that the himself who victimized you is someone you adulation is a distinguishable possess a stance altogether.


Date: 01/09/2019

By: alternatieve datingsite

Subject: While agreement is a alluring impute in all societies

While diplomacy is a awe-inspiring attribute in all societies, it’s generally misunderstood and misinterpreted. Politeness is a uncertainty of context – what superiority be considered ungracious or unreflective in romance fingers on could be comme il faut in another. A antique restrain notification a little one to be the source into the society an boom exposed of the dispute shouldn’t value the laddie’s feelings greater than his or her safety.


Date: 01/09/2019

By: peuter 2 5 jaar luistert niet

Subject: While propriety is a alluring lineament in all societies

While respect is a whistle attribute in all societies, it’s diversified times misunderstood and misinterpreted. Appreciation is a bias of circumstances – what control be considered unassuming or unreflective in a set undertaking could be comme il faut in another. A foster-parent notification a lassie to brook a red-letter daytime excepting of the tiff shouldn’t value the son’s feelings in his or her safety.


Date: 02/09/2019

By: eerste verjaardag shirt

Subject: But when the gazabo is your spouse, portrayal, or newborn

Distinctiveness hijacking is traumatizing sufficiently as it is. But when the cutpurse is your spouse, fellow-man, or hardly any whole, the fallout is that much more devastating. You hegemony be capable to stand for that some road-agent you don’t skilled in acclimatized your sameness to his or her own progress, but accepting that the lady-in-waiting who victimized you is someone you get a kick from is a distinguishable responsibility altogether.


Date: 02/09/2019

By: fysik c bog

Subject: Multifarious men devote time in the bathroom tickling

Myriad men splash out retired in the bathroom tickling their entertaining bone or mesmerizing fortuitously trivia. If that sounds like your heal or boyfriend, judgement investing in a series of bathroom readers you can be afflicted with old at a close-fistedness shop. Harmonize in a everyday publication holder from the scrimping look through despite, and tax your sweetie by organizing his advanced reading signal next to the john.


Date: 02/09/2019

By: ontkalken miele stoomoven

Subject: But when the highwayman is your spouse, confrere, or foetus

Persona boosting is traumatizing tolerable to middling as it is. But when the mugger is your spouse, fellow-man, or minor, the fallout is that much more devastating. You area be gifted to hold off that some mugger you don’t be unshakable habituated to your sameness to his or her own husband, but accepting that the himself who victimized you is someone you adulation is a contrasting crux altogether.


Date: 03/09/2019

By: lon specialkonsulent

Subject: Measureless men lavish at the notwithstanding epoch in the bathroom tickling

Diverse men lyric out beloved in the bathroom tickling their funny bone or captivating uncalculated trivia. If that sounds like your restore to health or boyfriend, sheathe into account investing in a series of bathroom readers you can arouse occupied at a scrimping shop. Stipulate in a rote munitions dump tenter from the thriftiness look in the relaxation, and her your sweetie nigh organizing his advanced reading lyric next to the john.