Filed in archive
The Vision Thing
by Scott Wilson on February 19, 2009
I'm found of saying that technology is cyclical, and at a certain level I think most people would certainly agree with me. You look at mainframe timesharing, you look at desktop PCs, you look at terminal services, you look at laptops, you look at SaaS, you start to see a certain repetition of basic concepts at the delivery level of information technology. Zoom your telescope in or out a bit and you'll see the same sort of cycling of concepts in such specific areas as programming languages or database modeling. Nothing is ever really new, is it? "This has all happened before, and it will happen again."
But there is a danger in looking at modern technologies through this prism of what has come before, because while the concepts may be similar, the details are often quite different. I fall into this trap frequently enough myself that I have to remind myself that while decisions should always be informed by history, they should never be chained to it. In this case, though, I think that's the trap that Mike Ogrinz, writing at JackBe's Enterprise Web 2.0 Blog, falls into when discussing mashups in terms of the Excel spreadsheets of yore.
Ogrinz, a consultant and enterprise architect who has authored the upcoming book "Mashup Patterns" to provide instruction and examples to other developers and architects seeking to create successful mashup systems, clearly has a good grasp of the detail of the new. And he correctly diagnoses one of the largest failings of the old, the tendency of massive, complex chunks of business logic to become embedded in unwieldy, undocumented Excel spreadsheets carefully horded by accountants away from the eyes of the IT department. No CIO or IT manager from the post-Visicalc era remained unscathed by such pockets of inbred resistance to centralized planning and efficiency. Vital data captured outside IT's centralized databases remained opaque and unreportable, and legions of consultants found employment when the renegade 'sheets were finally uncovered and had to be integrated into a systematic structure.
Ogrinz warns that mashups could share the same fate, that solutions developed in one department might be duplicated in others, without careful central planning and repositories. This is excellent advice, of course, albeit somewhat redundant: most of the mashup generating technologies we have are inherently collaborative; they are web-based, Web 2.0 informed, and come with sharing and searching built right in conceptually.
The comparison, however superficially analagous, mistakes exactly why Excel information silos were (and are) so destructive. It was never so much the development time or the inability to reuse the program logic. It was the fact that the information itself was duplicated or locked away from other units, and that the time and expense of maintaing or distributing that data increased with every new spreadsheet that sprung up containing it.
Mashups avoid this problem right out of the gate. They are very much the solution to the Excel silo problem (which is one of the reasons I have been excited about the technology) in and of themselves, because they rely on data that is centrally stored and maintained by their very nature.
It's true that Excel represented a powerful mechanism for end-users to assemble and process information outside the strict supervision of the IT department, and it's true that mashups provide the same capability. But mashups get right much of what Excel got wrong; the fact that they provide a similar capability doesn't automatically mean that they have similar pitfalls. All those CIOs who got burnt by the Excel silo problem may be leery of putting uncontrolled power into the hands of those users again, but shouldn't burden their decisions with the idea that it was the distribution of power that was the problem with that solution... the power should be pushed out as close to the end-user as is possible. The problem was the control of the integrity of the data, a problem that mashups solve rather neatly.
There is another old saw that the perfect is the enemy of the good. It's good to have a centralized repository of mashups and mashup chunks for users to re-use. The perfection of attempting to ensure that all mashups end up in that repository is a very different goal than the necessity of ensuring the integrity of the underlying data, and spending time and resources trying to discipline users into adopting the same versioning and repository behaviors as professional software developers does much to erase the advantages of giving them easy-to-use pseudo-development tools in the first place. It matters little if John in accounting and Suzy in HR both take ten minutes to whip up the same mashup to pull payroll data out of your ERP system. It's a one-time loss of ten minutes, yes; but it's not the ongoing problem that a similarly constructed Excel data silo would present, and it's cheaper than sending John and Suzy back to school to learn how to use a versioning system.
I don't think this is what Ogrinz was suggesting at all. I do, however, see it as the inevitable conclusion of some CIOs when they read that mashups might suffer the same disadvantages as Excel in the workplace.
Keep a central catalog of your mashups, by all means; make it web-based and easy to use. But don't sweat it when people don't use it universally, and don't get exercised when duplicated functionality starts showing up in the catalog. It should be a resource for users, not a constraint on their creativity... because that really misses the point of what mashups can do for your business.
But there is a danger in looking at modern technologies through this prism of what has come before, because while the concepts may be similar, the details are often quite different. I fall into this trap frequently enough myself that I have to remind myself that while decisions should always be informed by history, they should never be chained to it. In this case, though, I think that's the trap that Mike Ogrinz, writing at JackBe's Enterprise Web 2.0 Blog, falls into when discussing mashups in terms of the Excel spreadsheets of yore.
Ogrinz, a consultant and enterprise architect who has authored the upcoming book "Mashup Patterns" to provide instruction and examples to other developers and architects seeking to create successful mashup systems, clearly has a good grasp of the detail of the new. And he correctly diagnoses one of the largest failings of the old, the tendency of massive, complex chunks of business logic to become embedded in unwieldy, undocumented Excel spreadsheets carefully horded by accountants away from the eyes of the IT department. No CIO or IT manager from the post-Visicalc era remained unscathed by such pockets of inbred resistance to centralized planning and efficiency. Vital data captured outside IT's centralized databases remained opaque and unreportable, and legions of consultants found employment when the renegade 'sheets were finally uncovered and had to be integrated into a systematic structure.
Ogrinz warns that mashups could share the same fate, that solutions developed in one department might be duplicated in others, without careful central planning and repositories. This is excellent advice, of course, albeit somewhat redundant: most of the mashup generating technologies we have are inherently collaborative; they are web-based, Web 2.0 informed, and come with sharing and searching built right in conceptually.
The comparison, however superficially analagous, mistakes exactly why Excel information silos were (and are) so destructive. It was never so much the development time or the inability to reuse the program logic. It was the fact that the information itself was duplicated or locked away from other units, and that the time and expense of maintaing or distributing that data increased with every new spreadsheet that sprung up containing it.
Mashups avoid this problem right out of the gate. They are very much the solution to the Excel silo problem (which is one of the reasons I have been excited about the technology) in and of themselves, because they rely on data that is centrally stored and maintained by their very nature.
It's true that Excel represented a powerful mechanism for end-users to assemble and process information outside the strict supervision of the IT department, and it's true that mashups provide the same capability. But mashups get right much of what Excel got wrong; the fact that they provide a similar capability doesn't automatically mean that they have similar pitfalls. All those CIOs who got burnt by the Excel silo problem may be leery of putting uncontrolled power into the hands of those users again, but shouldn't burden their decisions with the idea that it was the distribution of power that was the problem with that solution... the power should be pushed out as close to the end-user as is possible. The problem was the control of the integrity of the data, a problem that mashups solve rather neatly.
There is another old saw that the perfect is the enemy of the good. It's good to have a centralized repository of mashups and mashup chunks for users to re-use. The perfection of attempting to ensure that all mashups end up in that repository is a very different goal than the necessity of ensuring the integrity of the underlying data, and spending time and resources trying to discipline users into adopting the same versioning and repository behaviors as professional software developers does much to erase the advantages of giving them easy-to-use pseudo-development tools in the first place. It matters little if John in accounting and Suzy in HR both take ten minutes to whip up the same mashup to pull payroll data out of your ERP system. It's a one-time loss of ten minutes, yes; but it's not the ongoing problem that a similarly constructed Excel data silo would present, and it's cheaper than sending John and Suzy back to school to learn how to use a versioning system.
I don't think this is what Ogrinz was suggesting at all. I do, however, see it as the inevitable conclusion of some CIOs when they read that mashups might suffer the same disadvantages as Excel in the workplace.
Keep a central catalog of your mashups, by all means; make it web-based and easy to use. But don't sweat it when people don't use it universally, and don't get exercised when duplicated functionality starts showing up in the catalog. It should be a resource for users, not a constraint on their creativity... because that really misses the point of what mashups can do for your business.
Permalink: Viewing new technologies through old prisms
Trackback: http://publish.creative-weblogging.com/publish/mt-tb.pl/144208
Mr Wong
Vote for Viewing new technologies through old prisms:
|
Rating: 6.00 out of 4 vote(s) cast.
|
Response from:
Mike Ogrinz
(02/20/09 8:16am)
Response from:
Scott Wilson
(02/20/09 12:13pm)
Hi Mike,
Thanks for commenting.
I get your complaint about the enterprise mash-up tools not always have built-in collaboration, but I have a different take on it, which is that too many vendors are trying to build too much collaboration into their products as it is. You really need a pre-existing, enterprise-level solution to that, or you risk spreading your attention too thinly... I call it "social networking fatigue." So that doesn't strike me as a black mark right off the top, although it certainly could be if implemented poorly.
We will have to agree to disagree on the issue of corporate control, or perhaps just agree that we are discussing the concept at different levels. For my part, I see the compliance, security, and data protection continuing to be addressed centrally; if somehow you have built a mashup tool which allows users to circumvent those things, then you have poorly architected the services it is tapping into. They simply shouldn't have the option to blow those things up; that was my point regarding the divergence of this solution from Excel, in that the data can continue to be centrally controlled even as the processing can be managed by the people most likely to get it right: those closest to the end of the chain.
I think I agree with you regarding the self-service movement, although I think IT can have greater involvement than simply providing tools. After all, you are correct about the expertise they have to offer. It's simply been mis-used in the past. I see IT's role as shifting away from the stance of "tell us what you need done, we'll do it for you" into "tell us what you are trying to do, we'll help you figure out how to do it." I think it is better for everyone if much of the control IS pushed out to the periphery; IT has long bungled business process jobs that end-users would never have fouled up so badly, and users have screwed over IT consistently by refusing to take ownership of projects which are ultimately designed to service their interests. IT should be more of a resource, less of a godhead. There are certainly aspects where centralized control is necessary or effective but the beauty of the services model is that you no longer have to pick one or the other, but can effectively blend both.
Either way, I'm looking forward to your book!
Regards,
Scott
Thanks for commenting.
I get your complaint about the enterprise mash-up tools not always have built-in collaboration, but I have a different take on it, which is that too many vendors are trying to build too much collaboration into their products as it is. You really need a pre-existing, enterprise-level solution to that, or you risk spreading your attention too thinly... I call it "social networking fatigue." So that doesn't strike me as a black mark right off the top, although it certainly could be if implemented poorly.
We will have to agree to disagree on the issue of corporate control, or perhaps just agree that we are discussing the concept at different levels. For my part, I see the compliance, security, and data protection continuing to be addressed centrally; if somehow you have built a mashup tool which allows users to circumvent those things, then you have poorly architected the services it is tapping into. They simply shouldn't have the option to blow those things up; that was my point regarding the divergence of this solution from Excel, in that the data can continue to be centrally controlled even as the processing can be managed by the people most likely to get it right: those closest to the end of the chain.
I think I agree with you regarding the self-service movement, although I think IT can have greater involvement than simply providing tools. After all, you are correct about the expertise they have to offer. It's simply been mis-used in the past. I see IT's role as shifting away from the stance of "tell us what you need done, we'll do it for you" into "tell us what you are trying to do, we'll help you figure out how to do it." I think it is better for everyone if much of the control IS pushed out to the periphery; IT has long bungled business process jobs that end-users would never have fouled up so badly, and users have screwed over IT consistently by refusing to take ownership of projects which are ultimately designed to service their interests. IT should be more of a resource, less of a godhead. There are certainly aspects where centralized control is necessary or effective but the beauty of the services model is that you no longer have to pick one or the other, but can effectively blend both.
Either way, I'm looking forward to your book!
Regards,
Scott
Subscribe
Marketplace
-
Online MBA Degrees - earn your mba degree online with one of hundreds of programs available at elearners.com
Use the search to look for other interesting posts
| RSS | See all blog subscribe options |
|
What is RSS? | |
| Yahoo! |
|
| Addthis |
|
| Bloglines |
|
| Newsletter | |
| Follow us on Twitter! |











While I agree with you that most web-based mashup tools already have a collaboration feature, many of the more powerful enterprise-grade products I have seen do not. When I asked one vendor what they did to support sharing mashups, the response was "you should use a shared network drive".
For the ten-minute job, you're right that there is less cause for concern. But enterprise-level mashups often require a significantly greater time investment. And if users are making multi-million dollar decisions based on these apps (as we have seen done with Excel), some kind of version trail is critical when the auditors come knocking.
Your point, "the power should be pushed out as close to the end-user as is possible." is admirable, but somewhat naive in heavily regulated corporate environments. The end user who uses mashups incognito to circumvent terms-of-use agreements, subscriptions, or security policies is going to create huge liabilities for his or her organization. I also disagree that ripping control away from centralized IT (who should be well versed in security and data protection issues) addresses issues of data integrity.
I think we are on common ground in realizing that the practice of enterprise development is undergoing a major shift as users move towards a more self-service environment.
At the risk of making another analogy you won't like ;-) , I will say it's similar to the rise of "do-it-yourself" home centers. I am sure that a large number of the people I see in Home Depot go home and build complete garbage. But - it serves their needs. Maybe the bookcase looks horrible and will fall over when someone bumps into it - but it solves their immediate problem and they feel a sense of empowerment having built it themselves.
BUT - at some level a minimum level of quality that is assured by the "provider". The lumber isn't rotten, the screws don't bend, and the paint is lead-free. This is how I see enterprise IT's new role in the emerging mashup landscape – delivering the working parts that help mashups work. And the socializing the solutions users create.
Don't just push tools down to users - give them the components they need in a manner that is safe and manageable. I think this is where mashups can benefit from all the SOA hype of the past few years. IT must become more of a service provider. But IT further needs to make sure that those services aren’t used in a way that jeopardizes the business of the organization. Governance should be on the mind of every good CIO.