SciDAC SSS Quarterly Report.


56 views
Uploaded on:
Category: Music / Dance
Description
Sandia is a multiprogram research center worked by Sandia Corporation, a Lockheed ... Fast status perspective of test execution. This screen loads when the EXECUTE catch is ...
Transcripts
Slide 1

SciDAC SSS Quarterly Report Sandia Labs August 27, 2004 William McLendon Sandia is a multiprogram research facility worked by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy\'s National Nuclear Security Administration under contract DE-AC04-94AL85000.

Slide 2

APItest - Overview Current Release : v0.2.0 Test Driver apparatus for testing programming Ordered tests API Testing Available for download: ftp://ftp.sandia.gov/active/apitest/

Slide 3

Scripted Test Driver XML based tests Object Oriented Easy to characterize new test sorts. Contingent test requesting Batch Scripts Can call different groups Built In Test Types Shell Script SSS Can set environment variables for tests. SUID Test Capability CAUTION! Timeouts User Interface Types Web Browser Command Line Test Results Export Save Test results to a XML document. Open Source LGPL Fully scripted in Python Portable APItest - Features

Slide 4

APItest - Requirements Packages required to run APItest: Python 2.3 or more noteworthy ElementTree ( www.effbot.org ) Twisted ( www.twistedmatrix.com ) ssslib ( ftp://ftp.mcs.anl.gov/bar/sss/) discretionary, for SSSlib tests.

Slide 5

APItest - Execution There are two approaches to execute APItest Command Line Only $> apitest - f test_file. [ apt|apb ] Web program GUI (Interactive) $> apitest httpd - i [- - iroot] : pull index to search for tests - p [- - port] : port number (default = 2112) - h [- - host] : host (default = localhost) - will show charge line utilization.

Slide 6

APItest - GUI (Top Page) Top level file page for APItest recurses from the [ testroot ] to discover tests. Record Extensions: TEST : .adept BATCH : .apb Batch tests appeared in strong Organized by index

Slide 7

APItest - GUI (Test Run Execution) Quick status perspective of test execution. This screen loads when the EXECUTE catch is chosen. Shading coded for simple review. Presently running test is shown. Invigorates each 15 secs.

Slide 8

APItest - GUI (Test Run Summary) Summary of test outcomes Color coding Batch Features Cumulative rundowns Total # of tests # that passed (green) # that fizzled (red) Can tap the hyperlinks to see more insights around a test or cluster.

Slide 9

APItest - GUI (Batch Summary) Clicking a hyperlink into a cluster test gives us a synopsis view. In this illustration, one test fizzled a reliance FAILDEP in the status section shows this. Tapping on the scriptTest2.apt connection will indicate us more information about this test.

Slide 10

APItest - GUI (Test Details - FAILDEP) Detailed perspective of scriptTest2.apt from past slide. Fizzled a reliance on cmdTest2.apt Expected : FAIL Actual : PASS

Slide 11

APItest - GUI (List of Test Runs) Clicking the View All Runs catch gives this screen. Trials are sorted by date and time. Click connections to view points of interest of a specific run.

Slide 12

APItest - GUI (Test Details - PASSED) Example of a test that was executed and passed. Rundown Data Dependency Data Only appeared if test was keep running as a component of a bunch. Yield Side-by-side examination Dependent on kind of test.

Slide 13

PREP TEST SDOFF SSS START TEST SDON RM EMNG SDSTAT SSS STOP TEST SDOFF SSS - Service Directory Startup Test

Slide 14

APItest - Ongoing Work Develop more tests for SSS parts! Approval by means of document coordinating. Design document. Test Developer GUI. Comes about program. Session administration and security (Cookies?) Additional local test sorts. HTTP, TCP/IP, XMLRPC DB Connectivity. Client Guide. Bug altering.

Slide 16

APItest - Test Types CMD Execute a charge by means of the order line. SCRIPT Execute a script. SSS Execute a ssslib correspondence.

Slide 17

APItest - Example CMD Test < testDef > < information > Example test. Runs ls - lr from/tmp, expects 0 exit status and any information. </information > < test sort =" cmd " wdir ="/tmp "> < order translator ="/receptacle/ksh "> ls </charge > < input name =" contention " position =" exacting "> - l </input > < input name =" contention " group =" strict "> - r </input > < input name =" stdin " design =" strict "/> < yield name =" stdout " design =" regexp "> .* </yield > < yield name =" stderr " group =" strict "/> < yield name =" status " form =" strict "> 0 </yield > </test > </testDef >

Slide 18

APItest - Example Script Test < testDef > < data > Timeout test </information > < test name =" timestamp1 " sort =" script " timeout =" 4 "> < summon mediator ="/container/bash " wdir ="/tmp "> for x in 1 2 3 4 5 6 7 8 9 10 do reverberate "timeout_test :${x}: `date`" rest 1 done </order > < yield name =" stdout " position =" regexp "> .*timeout.* </yield > < yield name =" stderr " group =" exacting "/> < yield name =" status " group =" exacting "> 0 </yield > </test > </testDef >

Slide 19

APItest - Example ENVVAR Test < testDef > < data > This script executes however adds some stuff to the earth. NOTE: setting envvar OVERRIDES any acquired environment variables. </information > < test sort =" script "> < order translator ="/receptacle/csh "> #!/container/csh env </summon > < input name =" envvar " design =" exacting " key =" test_envvar_1 "> foobar </input > < input name =" envvar " group =" strict " key =" test_envvar_2 "> foo </input > < yield name =" stdout " position =" regexp "> .*test_envvar_1=foobar\n.*test_envvar_2=foo\n.* </yield > < yield name =" stderr " position =" exacting "/> < yield name =" status " group =" strict "> 0 </yield > </test > </testDef >

Slide 20

APItest - Example SUID Test < testDef > < test sort =" script "> < charge mediator =" python " uname =" wcmclen " gid =" 500 "> #!/usr/canister/env python import os print os.getuid() print os.getgid() </charge > < input name =" contention ">/tmp/testuser/</input > < input name =" contention "> - l </input > < yield name =" stdout " design =" regexp "> ^27030$\n^500$ </yield > < yield name =" stderr " form =" strict "/> < yield name =" status " position =" strict "> 0 </yield > </test > </testDef >

Slide 21

APItest - Example SSS Test < testDef > < data > Sample sss question of the administration catalog </information > < test sort =" sss " goal =" administration registry "> < input name =" sendbuf "> &lt; get-location> &lt; area component=\'service-index\' host=\'*\' port=\'*\' protocol=\'*\' schema_version=\'*\' tier=\'*\'/> &lt;/get-location> </input > < yield name =" recvbuf " form =" regexp "> .* </yield > </test > </testDef >

Recommended
View more...