Clemens Utschig
This blog was migrated to http://blogs.oracle.com/soabpm
Hope to see you there.
SOA Suite 10.1.3.3 patchset and "lost" instances
After being in europe for conferences where I did evangelism on our next generation infrastructure, that is based on Service Component Architecture, it was time to revisit my roots and do some consulting in a POC as well as helping one of our customers with their performance problems.
Meanwhile, while I was on the road, we have released the 10.1.3.3 patchset, which includes among many small fixes here and there - some real cool enhancements, e.g
- A fault policy framework for BPEL, which allows you to specify policies for faults (e.g remoteFault) outside of the BPEL process and trigger retry activities, or submit the activity with a different payload from the console.
- Performance fixes for Oracle ESB - which boost the performance way up
- Several SOAP related fixes, especially around inbound and outbound WS-Security - if you happen to have Siebel and use WS-Sec features, the patch will make you happy
- Adapters: several huge improvements on performance and scalability
- BPEL 2 ESB: several fixes with transaction propagation as well more as sophisticated tracking
Back to my performance adventure.
The customer reported that under high load of his 10.1.3.1 instance, a lot of async instances (that were submitted to the engine) "got lost", which means - they could not find any trace of a running instance, nor have the target systems that were called out of the process being updated. Strange, isn't it?
A quick look into the recovery queue (basically a select against the invoke_message table) revealed that a lot of instances have been scheduled (status 0) - but somehow they stayed in the queue. Hugh, why that? Restarting the server helped, some instances were created but, - hugh still way to many weren't.
Checking the settings that we preseed - we figured out - that there is an issue with them. Looking into the Developer's guide it states:
"the sum of dspMaxThreads of ALL domains should be <= the number of listener threads on the workerbean".
Hmm - checking orion-ejb-jar.xml, section workerbean, in the application-deployments/orabpel/ejb_ob_engine folder revealed
- there are no listener-threads set and
- there are 40 ReceiverThreads
<message-driven-deployment name="WorkerBean" instances="100" resource-adapter="BPELjms">
A quick check with the JMS engineering enlighted me on that. As we use JMS connectors now - you need to change the ReceiverThreads, to match the above formula.
<config-property>
<config-property-name>ReceiverThreads</config-property-name>
<config-property-value>40</config-property-value>
</config-property>
- and tune the dispatcherThreads on the domains to a reasonable level.
Next question: what are dispatcherThreads, and what does the engine need them for?
"ReceiverThreads specifies the maximum number of MDBs that can process BPEL requests asynchronously across all domains. Each domain can allocate a subset of these threads using the dspMaxThreads property; however, the sum of dspMaxThreads across all domains must not exceed the ReceiverThreads value.
When a domain decides that it another thread to execute an activity asychronously, it will send a JMS message to a queue; this message then gets picked up by a WorkerBean MDB, which will end up requesting the dispatcher for some work to execute. If the number of WorkerBean MDBs currently processing activities for the domain is sufficient, the dispatcher module may decide not to request for another MDB. The decision to request or an MDB is based on the current number of active MDBs, the current number pending (that is, where a JMS message has been sent but an MDB has not picked up the message), and the value of dspMaxThreads.
Setting both ReceiverThreads and dspMaxThreads to an appropriate value is important for maximizing throughput and minimizing thread context switching. If there are more dspMaxThreads specified than ReceiverThreads, the dispatcher modules for all the domains will think there are more resources they can request for than actually exist. In this case, the number of JMS messages in the queue will continue to grow as long as request load is high, thereby consuming memory and cpu. If the value of dspMaxThrads is not sufficient for a domain's request load, throughput will be capped.
Another important factor to consider is the value for ReceiverThreads - more threads does not always correlate with higher throughput. The higher the number of threads, the more context switching the JVM must perform. For each installation, the optimal value for ReceiverThreads needs to be found based on careful analysis of the rate of Eden garbage collections and cpu utilization. For most installation, a starting value of 40 should be used; the value can be adjusted up or down accordingly. Values greater than 100 are rarely suitable for small to medium sized boxes and will most likely lead to high cpu utilization just for JVM thread context switching alone."
- Make sure your settings of ReceiverThreads do match the sum of dspMaxThreads of all domains, and are set appropriately.
- If you have external adapters in use, that connect e.g to AQ, make sure AQ is tuned and also the adapter - this is where you are most likely to get timeouts, that would also contribute to recvoverable messages.
BMW Oracle racing scores against Luna Rossa (Prada)
All this is America's Cup, the race for the old bowl.
JFK said this a while back ..
"We are tied to the ocean. And when we go back to the sea, whether it is to sail or to watch - we are going back from whence we came." --USA President John F. Kennedy, at a dinner for the crews in Newport, RI on the eve of the 1962 America's Cup Match.
[http://blog.bmworacleracing.com/]
today BMW Oracle got back into the race, by amazing tactics, and a sheer wonder of teamwork - 1:1 - let's wait for tmrw
Dave Chappell choins Oracle as Chief SOA Technologist
Being back from 4 weeks in Europe to give training, help customers, as well as speak at several conferences - I met Dave yesterday first time as oracle employee at java one - rocks!
Also, some weeks ago I have been interviewed by the theenterpriseedgeitarchitect.com on SOA, and what value it can bring into organization, when not viewed as "yet another IT pet project".
You can read the whole interview here
Oracle Develop hits the road
Oracle Develop: The Premier Conference for Developers
This spring, Oracle Develop—the premier conference for developers—is coming to a city near you. Don't miss it. You'll experience two days of expert-led, in-depth technical sessions, hands-on labs, advanced how-tos, and detailed tutorials. Work alongside the world's leading experts to expand your knowledge of popular technologies like Enterprise Java, SOA, .NET, Databases and PL/SQL, as well as Ajax, PHP, Spring, and more. This is your opportunity to network with local technologist while learning from the world's best.
More information can be found hereSjoerd Michels contributes to SOA Best Practice Series, on automated deployment
"In this Technical Note, you will learn to set up an automated build and deployment environment for your Oracle SOA Suite project. (Release 10.1.3.1 of Oracle SOA Suite features improved automated build capabilities; instead of the Oracle-specific obant Ant tool, plain-vanilla Ant is now used for building and deploying BPEL suitcases.) The goal is to automatically build Oracle's SOA Suite Order Booking demo application and deploy it to an Oracle Application Server instance that runs Oracle SOA Suite. Oracle's demo application is ideal here because it uses all the components in Oracle SOA Suite: Oracle Enterprise Service Bus (ESB), Oracle BPEL Process Manager, and Oracle Business Rules. The demo application also includes a number of Web services that are programmed in Java."
The whole article can be found here and while this one just got published there is lot more to come, especially around BPA, end to end design, and governance.
The next month will bring me back to europe to visit customers, help reviewing architectures, as well as speaking at several conferences throughout. Here is a sneak preview
- SOA Telecom conference, Paris
- Where I'll deep dive into implementing SOA in large enterprises and the many caveats when doing so
- JAX (EAKON) 2007, Wiesbaden
- After last year, I am happy to be back - this time on the SOA Management track, to evangelize together with a couple of good friends on the importance of the human factor
- EOUC 2007, Amsterdam
- The first year, the emea oracle user conference takes place, and it will be a blast - looking through the agenda, the lineup of sessions is unbelievable. I am happy to be part of it. This time it will be about technology, and the advanced concepts of the BPEL language.
Oracle SOA Suite 10.1.3.1 review - Oracle sows the seeds for SOA
Here is one quote
My experience with the Oracle SOA Suite revealed a top-notch toolset well-culled from a variety of sources without much sacrifice to aptitude or usability. When it comes to message routing and services orchestration, Oracle SOA Suite meets or exceeds most needs for governance, security, insight, and optimization at a price that’s hard to beat.
James R. Borck is senior contributing editor of the InfoWorld Test Center.
-- http://www.infoworld.com/article/07/01/22/04TCoraclesoa_2.html
Emjoy reading,..
OOP 2007 Keynote - Pictures
What a blast, monday evening - and a full room of interested people - something you don't see too often at conferences, where the exhibition starts on tuesday.
Everytime I speak at a conference on this topic I learn something new, from questions after a session as well as from how the crowd reacts. This time the biggest take-away from OOP - the waterfall is dead, at least there :D
Here are 2 pictures from my keynote.
Presenting at ODTUG Kaleidoscope 2007 in Orlando
I'll present on 3 topics, two for beginners, and one intermediate
- Managing successful SOA projects, a view beyond agile science
The session will give an inside view into methodologies applied to govern successful SOA projects.We will discover some of the common challenges by examining the different phases of a project and by splitting the project into different categories - each representing its own set of issues, and how these can be successfully mastered - applying the right tools and the right skills. An insiders view - to make your SOA projects successful. - Oracle 11g — Oracle's Next Generation SOA Infrastructure
which will give a sneak preview on 11g - the all integrated SCA based SOA plattform - Advanced Concepts of the BPEL Language
which is one of the sessions from last year that was very well attended and that I also presented at Oracle Open World last year
I hope to see you there - This conference is definetely worth the trip, and hey Daytona is not that bad :D
Heading for Europe - to support one of our key SOA Suite customers
I got the chance of a keynote at the OOP 2007 in Munich (Germany), speaking about Managing successfull SOA projects - and the importance of the human/organizational side in SOA projects.
If you happen to be at the OOP or around Munich, I think the entry to the demo pods / show floor is free - so come by and visit me - I'll be there to answer questions around SOA in general, demo the SOA Suite and meet customers.
Also during the week I'll be visiting one of our customers in Germany to make sure their large, and fledged SOA implementation hits the target.
With this in mind, and all the feedback we receive from the fields in our OTN forums I am very happy to see the industry and the market adopting our SOA Suite, the latest edition of, an all over integrated plattform from Governance, Development and Security, to BPEL as well as ESB.
Business Integration Journal changes its name - and the last BIJ contains my new article
Targeted at the intersection of business and IT, BTIJ carries on the “how-to” and “what-works” tradition of Business Integration Journal helping IT and business managers quickly adapt to changing business needs, continuously innovate successful new products and services, and consistently gain and maintain a competitive advantage."
In the last edition of the BIJ - as we know it - my article on SOA projects got published - and I am very proud of it.
"A World of Assumptions That Make an SOA Project the Perfect Storm—and What You Should Know About Them by Clemens Utschig-Utschig. This article shows that, while Service-Oriented Architecture (SOA) brings many advantages, it doesn’t alleviate the need for good planning, organization, and training."
The whole article can be found here
http://www.bijonline.com/index.cfm?section=article&aid=802
A new SOA year has begun - what will the SOA Santa bring?
My first year, living in San Francisco and working within a wonderfull group, envisioning future and creating our next generation products went by - and I must admit it was far better than I thought it'd be.
First, and most important - we delivered SOA Suite 10.1.3.1 - the first major, integrated SOA plattform. Not just integrated, but also with two new key components, the Oracle Enterprise Service Bus (ESB) and Rules. Since OOW 2006 we we presented the first public available release, our customers are using it heavily to build their next generation SOA - and according to many of them - they enjoy doing so :D
Also, we signed an OEM agreement with IDS Scheer, to build the ORACLE BPA Suite on top of it. Using Business Process Architect - for the first time Business Processes will make it all the road down to be executable, and all the way back to feed real world data into simulation and continous refinement.
Another also, was the overwhelming amount of SOA related sessions at Oracle Open World, and the great feedback we received. It was a blast, more than 40000 people made the city for one week being red, being Oracle. Elton John played during the big Oracle party, and so on.
Open SOA - www.osoa.org went live - and with it the big players in the SOA market space, to drive next generation, easy to use standards.
So after all what's in for 2007?
While we all work hard on delivering 11g - our next generation SOA infrastructure, based on Service Component Architecture (SCA) and supporting Service Data Objects (SDO) - we expect a patchset for 10.1.3.1 (which will offer a ton of new features, and little fixes here and there).
BPEL 2.0 will see the light of life - after more than 2 years, and the last public review finished, some more polishing needs to happen - and then we are ready to go. With it - BPEL will present a number of long awaited cool features, such as the new variable layout ($inputVariable) and scoped partnerlinks.
Evangelism on SOA will continue to drive the spirit of SOA and help customers adopting to it - I really look forward to even more presence around the globe, and many customers going live on SOA Suite.
Personally for me - it's moving on with my SOA Best practices series on OTN, supporting people around the globe and the OTN forums, doing evangelism on SOA & help creating 11g. More than enough.
From JavaPolis to Nordwijk aan Zee
For the organizers of JavaPolis - it was a great time theree - and 2 thumbs up - for a VERY well organized conference. For me it was something new, speaking in a cinema, and definetely in front of the biggest screen ever (15 * 8 meters)
More pictures can be found here
So I'd recommend for next year to put JavaPolis 2007 into your calendar and join me and 1000 other java geeks :D
Coming back from Gartner's SOA Summit and heading out to Europe
Two sessions, of the many I attended, left me thinking on SOA and where we go from here.
Darrell Plummer, Gartner Analyst, held a How to workshop on creating SOA applications, which turned out great.. He fostered a broad discussion in the audience, on what methodologies to use, what a service really is - beyond WSDL, and so forth. A nice metric: out of 15 slides he wanted to show, he showed 5 :D (the rest of the time went into discussion)
and the Chief Architect of Eskom, talked about SOA and his experiences in South Africa - about a company, that adapted to agility, about key stakeholders, and the value of SOA. Overall - SOA is about humans - two thumbs up.
After being home for two days - I'll head to Europe today night (yes on LH 459, Kranich) - for JavaPolis, and to visit customers. Getting the chance to speak at JavaPolis 2006 is a great opportunity to evangelise on standards based SOA - and also that we got a slot for the university part.
Hugo Brand (from our EMEA PM team), Demed Lher (OEMS/ESB PM) and me will talk about Pragmatic SOA, and how you can build composite SOA applications today.
So if you are around, come by to get a 3 hour, intense, and interactive how to session - or just to say hello :D
Oracle SOA Suite Patterns and Best Practices, Part 1 and 2
The first 2 chapters are live and can be found here.
Chapter 1: Virtualizing your service endpoints in ESB and using them from BPEL
Chapter 2: Using the Service Registry to enable a dynamic, reusable SOA
- more to come soon
Jeff, Mr. B2B is on the way finishing his contribution on BPEL and B2B and how those two components can make trading simple and solid.
Also coming in the next time, migration, deployment concepts, and governance, all from the source.
We are also keen for your feedback, or if you like to contribute, jsut drop me a line with what you think helps the community most
Gartner Application Integration & Web Services Summit
Dave Shaffer - Director of SOA Product Mgmt - and head of our group, Devesh Sharma - Mr. BPA, Jeff Hutchins - the mastermind of Oracle's B2B and me will be there. So if you are around, come by the booth to chat, see SOA Suite @ work or just for fun - to meet some of the faces behind Oracle's SOA strategy and offering.
For those who have not heart of it yet - visit http://www.gartner.com/2_events/conferences/apn17.jsp and hurry to register
c ya in orlando
Develop with Oracle Fusion Middleware and win a trip to Oracle HQ
The Oracle Fusion Middleware Developer Challenge is looking for submissions in three exciting technology areas:
- SOA-based applications or Web services
- Web 2.0/Ajax-based user interfaces or mashups
- Java-based applications demonstrating the combined use of Oracle and Open Source software
Naturally we, all Oracle employees are excluded - so it's your term. Develop the coolest application on Oracle's new Fusion Middleware and win a trip to our Headquarters in Redwood Shores, California.
Oracle Open World 2006 slides and two new articles
My slides about Advanced BPEL topics, including Compensation, Transactions, and WSIF can be found here.
Matt Shannon from the Content DB team and me teamed up to demo the integration between Content DB and Oracle BPEL PM, which currently evolves into a sample - slides are here
Also the introduction during Oracle XTreme that me and my whole team gave - on using all the components together to create a composite application is online - and to be found here
Attention: you need to login with cboracle/oraclec6
Also two recent articles were published, ..
One on Data Services in the Java Developers Journal, where Doug Clarke from Toplink PM team and me paired up, to write about "Accessing data in the Service Oriented World" is here.
The second one, where Jesus from TwoConnect, Heidi Buelow- one of my fellows on our team and I teamed up - to demonstrate "WSI with BPEL and WCF in the real world". It can be found here.
Also, to keep my fellow readers informed, I just started off with my best practice series on the SOA Suite, which explores patterns and best practices when using the components - more on this soon.
The biggest Openworld ever closed its doors - and what a great time it was
As most of my team, I litterally spent the whole week at Oracle World, as we constantly went back and forth from the demo grounds, to Oracle Develop, located at the Hilton, and customer meetings.
The first highlight? The SOA Suite distribution (for all number junkies, it's 10.1.3.1.0) made it also in time, to be released to OTN (here) - yeah!
In a nutshell, what did happen?
- Larry Ellison talked about the Oracle supported Linux
- In his Fusion Revolution keynote, Thomas, once more lined out the importance of standards
Also a bunch of whitepapers made it in time for Oracle World, perfectly in line with Thomas' Keynote on standards. They can be found here
My sessions on "Integrating Content DB with Oracle BPEL Process Manager", "Advanced BPEL" and "SOA in the real world" - were very well attended, and especially overwhelming was the crowd interested in the advanced stuff on BPEL, covering themes like transactions, compensation, fault handling and BPEL 2.0.
.. and while blogging here from some 34000 feet - somewhere over England en route to Germany, my laptop battery is going down, mostly because of the non working poweplugs on LH 455, whatever .. I'll blog more on OOW when I get the pics that friends took during the week.
Oracle Open World 2006 - and the last preparations - this time JDev team
It's about BPEL and ESB development in Oracle's JDeveloper - you can be found here.
Enjoy - and even more if you come to see us live at this year's Oracle Open World.