BDN - Banner Developer Network

One of our greatest challenges in the past few years here at the University of Illinois has had to do with the nightly population of our locally grown data warehouse. It currently takes 14 hours or so for the ETL to run each day. It starts at midnight so it usually finishes around 2 PM. Right, not a real people pleaser with that kind of delivery time. I manage the DBA team here for our enterprise applications which includes both our Banner system and our Enterprise Data Warehouse. Complicating the whole technical set of issues has been some political/organizational issues. You see the department in charge of the development and maintenance of the EDW is not the same as the department responsible for Banner and the other enterprise applications. My DBAs are in the department responsible for Banner. The folks responsible for the EDW use our DBA services but they have their own ETL developers, Data Analysts, Business Analysts, etc. I tell you these things so that you can understand a little better some of the challenges I intend to post about where we've been, where we are at, and where we're going with our EDW environment as we seek to fix the 14 hour ETL window. As with my posts about Banner on Oracle 10g, I'm hoping this blog will help others learn from what we've done so that you may be able to avoid the problems we've faced.

If this blog draws enough interest I may even submit the topic as a potential Summit session for next Spring.

More later.