Performance Test Driven Development with Oracle Coherence

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Test Driven Development
with Oracle Coherence
Alexey Ragozin
London, 18 Jul 2013

Presentation outline
• Motivation
• PTDD philosophy
• Oracle Coherence under test
 Coherence Vs. Testing
 Small cluster ...

This code works
Filter keyFilter = new InFilter(new KeyExtractor(), keySet);
EntryAggregator aggregator = new Count();
Obj...

This code also works
public static class MyNextExpiryExtractor implements ValueExtractor {
@Override
public Object extract...

And this also looks Ok
@LiveObject
public static class MyLiveObject implements PortableObject {
// ...
@EventProcessorFor(...

Another slide to scare you
API
Cache
service
Packet
publisher
Packet
speaker
OS
Packet
listener
Packet
receiver
OS
Service...

Functional Vs. Fast
 You have paid for Coherence
 You have paid for gigabytes of RAM
 You have spent time developing so...

PTTD Philosophy
Working cycle
 Write simplest functional code
 Benchmark it
 Improve based on test measurements
Never o...

Testing Coherence
Challenges
 Cluster required
 Sensitive to network
 Database is usually part of solution
 Massive pa...

Testing Coherence
Benefits
 Pure Java, less hurdle with OS tweaking etc
 Nodes are usually plain J2SE processes
 you ca...

Benchmarking and cluster size
Single node cluster may reveal
 server side processing issues
Small cluster 2-8 physical se...

Areas to keep eye on
Extractors, queries, indexes
• query index usage
• query plans for complex filters
• POF extractors
S...

Automation
“Classic” approach
 bash + SSH + log scraping
Problems
 not reusable
 short “half-live” of test harness
 Ja...

Automation
Stock performance test tools
 Deployment are not covered
 Often “web oriented”
 Insufficient performance of ...

Automation – Game changer
cloud = CloudFactory.createSimpleSshCloud();
cloud.node("cbox1");
cloud.node("cbox2");
cloud.nod...

Automation – Game changer
NanoCloud - http://code.google.com/p/gridkit/wiki/NanoCloudTutorial
• Managing slave nodes
 in-...

Automation – Game changer
Full stack
• Maven – ensure test portability
• Nanocloud – painless remote execution
• JUnit – t...

Simple microbench mark
@Before
public void setupCluster() {
// Simple cluster configuration template
// Single host cluste...

$Simple microbench mark @Test public void verify_full_vs_index_scan() { // Tweak JVM arguments for storage nodes JvmProps.a...$

Monitoring
 Server CPU usage
 Process CPU usage
 Network bandwidth usage
 Coherence threads CPU usage
 Packet Publish...

Flavors of testing
 Distributed micro benchmarks
 Performance regression tests
 Bottlenecks analyzing
 Performance sig...

Flavors of testing
 Distributed micro benchmarks
• Micro benchmark using real cluster
• Proving ideas
• To be run manuall...

Flavors of testing
 Distributed micro benchmarks
 Performance regression tests
• To be run by CI
• Execute several stabl...

Flavors of testing
 Distributed micro benchmarks
 Performance regression tests
 Bottlenecks analyzing
• Testing through...

Flavors of testing
 Distributed micro benchmarks
 Performance regression tests
 Bottlenecks analyzing
 Performance sig...

Flavors of testing
 Distributed micro benchmarks
 Performance regression tests
 Bottlenecks analyzing
 Performance sig...

Common pit falls
 Measuring “exception generation” performance
 always validate operation results
 write functional tes...

Common pit falls
Fixed user Vs. Fixed request frequency
Fixed users
 5 threads
 5 operations out of 50k
will fall out of...

Links
• Nanocloud
 http://code.google.com/p/gridkit/wiki/NanoCloudTutorial
• ChTest – Coherence oriented wrapper for Nano...

Thank you
Alexey Ragozin
alexey.ragozin@gmail.com
http://blog.ragozin.info
- my blog about JVM, Coherence and other stuff