|8:45 - 9:45||
Welcome and New Introductions
Context: ISERN is open to academic and industrial groups world-wide that are active in experimental software engineering research and willing to adopt the experimental research framework. ISERN members are pairs of organization and contact person. If the contact person leaves the organization, the organization must reapply for membership. Interested organizations may apply by sending an electronic proposal to "isern at informatik.uni-kl.de" describing their past experience in experimental software engineering research as well as their expectations from a future ISERN membership. Candidates will be invited to observe the ISERN Meeting following their application.
Goal of the session: To facilitate the membership application process by giving an opportunity for candidates to present their research and for observers to introduce themselves.
Session Format: Membership is granted according to a 3-step procedure:
Dieter Rombach: Introduction of members, candidates, and observers.
Current members present 1-minute contact/affiliation changes:
Candidates give a 5 min presentation each:
Observers give 2 min introduction without a presentation:
Reports from the 2007 Session Chairs
|10:00 - 10:30||
ESE Methods: Aggregating results from Experiments
Chair: N. Juristo
Goals:Aggregation should be taken to mean the combination of the results of more than one experiment to generate pieces of knowledge that can be used in practice to develop software. The fact that one experiment yields certain results should not be taken as evidence enough to consider these results as a proven fact. Taken separately, experiments provide partial results, while conclusive results or evidence can be gained by accumulating partial results
Context:In its early days, Empirical SE (ESE) focused on studying the application of the principles of the laboratory and experiment to SE. Twenty years later, running lab experiments in ESE is a fairly well understood task. But running isolated experiments is just one step of the experimental paradigm. Other principles of experimentalism remain to be analysed and adapted to SE: Experiment reporting; Replication; Systematic reviews; Aggregation, etc.
Facilitators:Marcus Ciolkowski, Forrest Shull
|13:30 - 14:00||
Chair: M. Barker
Goals:the goal of this session is to provoke discussion about the use of agile methods in developing safe software. I expect people will talk about security, but safety can also include other elements.
Context:we usually have something about agile methods, and security and operational software are often touchstones for empirical software engineering.
Outcomes:a key outcome should be providing everyone with a better understanding of the trade-offs involved in using agile methods. A secondary outcome may be reminding people about the effectiveness of debating as a method of investigation and decision-making.
Facilitators:right now I think it's just me. I need to have at least four debate members (two per side) and would like to have up to eight (four per side).
Readings:this would depend on the debate members. I don't think there is any particular preparation readings -- the debate presentations should cover it.
Application of ESE: Applying Empirical Software Engineering to Software Architecture
Chair: G. Cantone
Goals: Gathering information regarding software architecture from the point of view of the ISERN members in the context of an ISERN session by focusing on (1) How a study of software architecture is similar to/different from a study on any other software engineering topic, (2) Measurement models for goodness of software architecture, and possibly (3) How we teach software architecture around the different countries.
Context:empirical software engineering scientists with some experience in conducting experiments on software architecture topics usually with students. Limited participation of software architecture practitioners.
Facilitators:M. AliBabar, J. Carver, D. Cruzes, D. Falessi, O. Pastor, F. Shull, and G. H. Travassos.
|15:00 - 15:30||
Roadmap: Aligning ISERN 2010 Milestones and Associated Key Tasks
Chairs: N. Oza, S. Biffl
Goals:Main goal of the session is to develop a community-level understanding of ISERN's key milestones by 2010, and a set of achievable key tasks we need to carry out as a community to achieve these milestones. The session will foster understanding of the task candidates and their impact on the ISERN milestones. The session will also help to develop consensus oriented understanding in the community in ISERN's goals and means to achieve those goals. The session is facilitated by the session chairs with customized version of an SPI-Stakeholder method and tool support developed earlier.
Context:Recent ISERN meeting sessions discussed goals for the ISERN research roadmap and value-based methods for empirical research. The ISERN community is growing and emerging as an important contributor to Software Engineering research with particular focus on Empirical Methods. The community representatives gathering in Kaiserslautern is a good opportunity to understand what each member feels for community development and goals. The session will address it by aggregating collective understanding which can then be used to identify or refine the actions at the community level.
Facilitators:Barry Boehm, Dietmar Winkler
Wrap-up and plan for Tuesday
Meeting of the ISERN Steering Committee (invitation)
ESE Methods: Guidelines for conducting and reporting qualitative research - Subtitle: Stories from the trenches
Chair: C. Seaman
Goals:- Benefit from the experience of the many, many ISERNers who have dabbled in qualitative research methods. Share stories about:
Context:By my count, since 1995 (my first ISERN meeting), we have discussed qualitative methods at least 5 times, covering basic concepts, validity concerns, and guidelines for reporting. Now that there is a critical mass of ISERN researchers who have at least tried some qualitative research, it's time to start sharing experiences.
Facilitators:Carolyn Seaman (again!), but this time with help from some friends. Let me know if you have experiences you'd like to share, or just bring them to the session!
|10:30 - 11:00||
Chair: R. Selby
Goals: At ISERN 2007, we discussed and critiqued the proposed roadmap for Empirical Software Engineering (ESE). The goal for ISERN 2008 is to use the ESE roadmap to help identify collaboration opportunities and accelerate progress toward achieving broad ESE goals.
Context: We have 90 minutes for this roadmapping session, and we plan to use the time as follows:
Facilitators:Rick Selby and Laurie Williams
ESE Methods: Empirical Investigation Using Simulation
Chair: Dan Port
Goals:Our objective for this session is to raise awareness and initiate the development of guidelines for appropriate application of simulation for acquiring empirical evidence and validation of inaccessible software engineering research conjectures, claims, and hypothesis. It is not our intent to explicitly discuss the details for design of simulation studies (perhaps a future session) although it is inevitable that some discussion of this will occur. We wish to make best use of the collection of experience and expertise of ISERN members in this very limited amount of time available.
Context:For many software engineering methods verifying the benefit of following a particular approach is a challenge. Intangible values such as benefit are difficult to measure directly, industry and student/classroom based experimental studies are generally impractical to use for large numbers of experiments to achieve statistical significance, and access to industry data is often limited. Simulation offers an attractive approach to generate empirical evidence for validating and investigating fundamental software engineering properties.
Facilitators:Jeff Carver, Juergen Muench, Dietmar Pfahl
|15:00 - 15:30||
|15:30 - 16:30||
Chair: A. Jedlitschka
Goals:ISERN is a healthy, productive social organization that is stuck in 1990's technology (email + simple static website), and even that technology does not appear to be used all that well. Nevertheless, we get things done somehow. In the past few years, a great number of innovative social network technologies have appeared, including: MySpace, FaceBook, Twitter, FriendFeed, BlogSpot, MediaWiki, etc. The goal of this session is to ask two kinds of questions:
Context: ISERN Portal Requirements
Readings: The ISERN Web site