This paper explains how to use a new software tool for argument diagramming available free on the Internet, showing especially how it can be used in the classroom to enhance critical thinking in philosophy. The user loads a text file containing an argument into a box on the computer interface, and then creates an argument diagram by dragging lines from one node to another. A key feature is the support for argumentation schemes, common patterns of defeasible reasoning historically know as (...) topics . Several examples are presented, as well as the results of an experiment in using the system with students in a university classroom. (shrink)

Philosophy lacks criteria to evaluate its philosophical theories. To fill this gap, this essay introduces nine criteria to compare worldviews, classified in three broad categories: objective criteria (objective consistency, scientificity, scope), subjective criteria (subjective consistency, personal utility, emotionality), and intersubjective criteria (intersubjective consistency, collective utility, narrativity). The essay first defines what a worldview is and exposes the heuristic used in the quest for criteria. After describing each criterion individually, it shows what happens when each of them is violated. From the (...) criteria, it derives assessment tests to compare and improve different worldviews. These include the is-ought, ought-act, and is-act first-order tests; the critical and dialectical second-order tests; the mixed-questions and first-second-order third-order tests; and the we-I, we-it, and it-I tests. The essay then applies these criteria and tests to a concrete example, comparing the Flying Spaghetti Monster deity with Intelligent Design. For another application, it draws more general fruitful suggestions for the dialogue between science and religion. (shrink)

In recent years, academics and educators have begun to use software mapping tools for a number of education-related purposes. Typically, the tools are used to help impart critical and analytical skills to students, to enable students to see relationships between concepts, and also as a method of assessment. The common feature of all these tools is the use of diagrammatic relationships of various kinds in preference to written or verbal descriptions. Pictures and structured diagrams are thought to be more comprehensible (...) than just words, and a clearer way to illustrate understanding of complex topics. Variants of these tools are available under different names: “concept mapping”, “mind mapping” and “argument mapping”. Sometimes these terms are used synonymously. However, as this paper will demonstrate, there are clear differences in each of these mapping tools. This paper offers an outline of the various types of tool available and their advantages and disadvantages. It argues that the choice of mapping tool largely depends on the purpose or aim for which the tool is used and that the tools may well be converging to offer educators as yet unrealised and potentially complementary functions. (shrink)

In this philosophical paper, we explore computational and biological analogies to address the fine-tuning problem in cosmology. We first clarify what it means for physical constants or initial conditions to be fine-tuned. We review important distinctions such as the dimensionless and dimensional physical constants, and the classification of constants proposed by Lévy-Leblond. Then we explore how two great analogies, computational and biological, can give new insights into our problem. This paper includes a preliminary study to examine the two analogies. Importantly, (...) analogies are both useful and fundamental cognitive tools, but can also be misused or misinterpreted. The idea that our universe might be modelled as a computational entity is analysed, and we discuss the distinction between physical laws and initial conditions using algorithmic information theory. Smolin introduced the theory of "cosmological natural selection" with a biological analogy in mind. We examine an extension of. (shrink)

The importance of teaching critical thinking skills at the college level cannot be overemphasized. Teaching a subcategory of these skills—argument analysis—we believe is especially important for first-year students with their college careers, as well as their lives, ahead of them. The struggle, however, is how to effectively teach argument analysis skills that will serve students in a broad range of disciplines.

Many undergraduates, philosophy majors included, read philosophical texts similar to the way they read stories. One method for teaching students how to discern the argumentative structure of a philosophy text is through argument diagrams (text boxes used to represent claims with arrows and lines used to represent connections between these claims). This paper provides criteria for an ideal argument diagramming software and then reviews the strengths and weaknesses of such software currently available, e.g. Araucaria, Argutect, Athena Standard, Inspiration, and Reason!Able.

A large body of evidence suggests that the Personalized System of Instruction (PSI) improves learning. In courses that use PSI, the material is divided into units, students must pass a test on each unit before advancing to the next unit, there’s no group-level instruction, and students advance in the course at their own pace. While studies find that PSI improves learning outcomes in a wide range of settings, researchers haven’t studied the effectiveness of PSI in critical thinking classes. In this (...) paper, I argue that teaching critical thinking with PSI can effectively promote critical thinking skills. I describe a course that uses PSI to teach critical thinking and I present evidence from pre- and post-tests that indicates that students substantially improved their reasoning skills in this course. I also discuss the costs and drawbacks of using this method of instruction and consider ways of addressing these problems. (shrink)

Argument-mapping software abounds, and one of the reasons is that using the software has been shown to teach/promote/improve critical thinking skills. These positive results are very encouraging, but they also raise the question of whether the computer tutorial environment is producing these results, or whether learning argument mapping, even with just paper and pencil, is sufficient. Based on the results of two empirical studies, I argue that the basic skill of being able to represent an argument diagrammatically plays an important (...) role in the improvement of critical-thinking skills. While these studies do not offer a direct comparison between the two methods, it is important for anyone wishing to employ argument mapping in the classroom to know that significant results can be obtained even with the most rudimentary of tools. (shrink)

Computer-Assisted Argument Mapping (CAAM) is a new way of understanding arguments. While still embryonic in its development and application, CAAM is being used increasingly as a training and development tool in the professions and government. Inroads are also being made in its application within education. CAAM claims to be helpful in an educational context, as a tool for students in responding to assessment tasks. However, to date there is little evidence from students that this is the case. This paper outlines (...) the use of CAAM as an educational tool within an Economics and Commerce Faculty in a major Australian research university. Evaluation results are provided from students from a CAAM pilot within an upper-level Economics subject. Results indicate promising support for the use of CAAM and its potential for transferability within the disciplines. If shown to be valuable with further studies, CAAM could be included in capstone subjects, allowing computer technology to be utilised in the service of generic skill development. (shrink)

This paper is in two parts. Part I outlines three traditional approaches to the teaching of critical thinking: the normative, cognitive psychology, and educational approaches. Each of these approaches is discussed in relation to the influences of various methods of critical thinking instruction. The paper contrasts these approaches with what I call the “visualisation” approach. This approach is explained with reference to computer-aided argument mapping (CAAM) which uses dedicated computer software to represent inferences between premise and conclusions. The paper presents (...) a detailed account of the CAAM methodology, and theoretical justification for its use, illustrating this with the argument mapping software Rationale™. A number of Rationale™ design conventions and logical principles are outlined including the principle of abstraction, the MECE principle, and the “Holding Hands” and “Rabbit Rule” heuristics. Part II of this paper outlines the growing empirical evidence for the effectiveness of CAAM as a method of teaching critical thinking. (shrink)

There is substantial evidence from many domains that visual representations aid various forms of cognition. We aimed to determine whether visual representations of argument structure enhanced the acquisition and development of critical thinking skills within the context of an introductory philosophy course. We found a significant effect of the use of argument diagrams, and this effect was stable even when multiple plausible correlates were controlled for. These results suggest that natural⎯and relatively minor⎯modifications to standard critical thinking courses could provide substantial (...) increases in student learning and performance. (shrink)

Part I of this paper outlined the three standard approaches to the teaching of critical thinking: the normative (or philosophical), cognitive psychology, and educational taxonomy approaches. The paper contrasted these with the visualisation approach; in particular, computer-aided argument mapping (CAAM), and presented a detailed account of the CAAM methodology and a theoretical justification for its use. This part develops further support for CAAM. A case is made that CAAM improves critical thinking because it minimises the cognitive burden of prose and (...) the demands that arguments in prose typically place on memory. CAAM also has greater usability, complements the imperfect human cognitive system, and adopts a logic of semi-formality which is both natural and intuitive. The paper claims that CAAM is an important advance given that traditional stand-alone critical thinking courses do not teach critical thinking as well as they as they are assumed to do. It is also important given that tertiary education fails to deliver improvements in critical thinking gains for too many students. The paper outlines results from a number of empirical studies that demonstrate that CAAM yields robust gains in critical thinking as measured by independent tests. Students themselves also believe CAAM to be beneficial as noted in coded responses to surveys. I conclude the paper by comparing the traditional approaches to the teaching of critical thinking to the visualisation approach. I argue that CAAM should taken seriously in the context of contemporary educational practices. (shrink)

The articles included in this issue represent some of the most recent thinking in the area of critical thinking in higher education. While the emphasis is on work being done in the Australasian region, there are also papers from the USA and UK that demonstrate the international interest in advancing research in the area. -/- ‘Critical thinking’ in the guise of the study of logic and rhetoric has, of course, been around since the days of the ancient Greeks and the (...) early beginnings of universities. In a narrower sense, critical thinking has been central to higher education as a desirable attribute of graduates since at least the beginning of the twentieth century. The work of John Dewey, and others, emphasised the importance of ‘good habits of thinking’ as early as 1916. In 1945, the Harvard Committee placed emphasis on the importance of ‘thinking effectively’ as one of three desirable educational abilities in their General education in a free society. This was later endorsed in 1961 by the US-based Educational Policies Commission: ‘The purpose which runs through and strengthens all other educational purposes … is the development of the ability to think’ (Kennedy, Fisher, & Ennis, 1991, pp. 11–12). -/- In recent times, universities have made a point of emphasising the importance of critical thinking as a ‘generic skill’ that is central to most, if not all, subjects. There is not a university today (in Australia at least) that does not proudly proclaim that their graduates will – as a result of a degree program in their institution – learn to think critically. Further, there is rarely a subject taught that does not offer the opportunity to acquire skills in critical thinking. However, where is the evidence that we teach critical thinking in higher education? Disturbingly, despite our best intentions, it appears we may be teaching very little of it. (shrink)

Kognitive Dissonanzen und Inkonsistenzen gehören zu den zentralen Charakteristika philosophischer Probleme. Gleichzeitig wird die Philosophie zurecht dafür gepriesen, dass sie wichtige Kompetenzen und Tugenden fördert – etwa begriffliche Klarheit, treffende Problemanalyse, gute Argumentation, Kritikfähigkeit, Offenheit und konstruktives Diskutieren. Eine wichtiges Anwendungsgebiet dieser Kompetenzen und Tugenden besteht ihrerseits darin, Auswege aus kognitiven Dissonanzen finden und argumentativ begründen zu können. Inkonsistenzen sind demnach eine wichtige Gelenkstelle zwischen den Themen und Fragen der Philosophie und den zentralen Kompetenzen und Tugenden, die im Philosophieren ausgeübt (...) und geschult werden. So zumindest die Arbeitshypothese, die in diesem Beitrag verfolgt werden soll, und die zum Teil und in unterschiedlichen Hinsichten an vorliegende Ansätze anknüpft. (shrink)

An argument map visually represents the structure of an argument, outlining its informal logical connections and informing judgments as to its worthiness. Argument mapping can be augmented with dedicated software that aids the mapping process. Empirical evidence suggests that semester‐length subjects using argument mapping along with dedicated software can produce remarkable increases in students’ critical thinking abilities. Introducing such specialised subjects, however, is often practically and politically difficult. This study ascertains student perceptions of the use of argument mapping in two (...) large, regular, semester‐length classes in a Business and Economics Faculty at the University of Melbourne. Unlike the semester‐length expert‐led trials in prior research, in our study only one expert‐led session was conducted at the beginning of the semester and followed by class practice. Survey results conducted at the end of the semester, show that, with reservations, even this minimalist, ‘one‐shot inoculation’ of argument mapping is effective in terms of students’ perceptions of improvements in their critical thinking skills. (shrink)

The research described here explores the idea of using Supreme Court oral arguments as pedagogical examples in first year classes to help students learn the role of hypothetical reasoning in law. The article presents examples of patterns of reasoning with hypotheticals in appellate legal argument and in the legal classroom and a process model of hypothetical reasoning that relates them to work in cognitive science and Artificial Intelligence. The process model describes the relationships between an advocate’s proposed test for deciding (...) a case or issue, the facts of the hypothetical and of the case to be decided, and the often conflicting legal principles and policies underlying the issue. The process model of hypothetical reasoning has been partially implemented in a computerized teaching environment, LARGO (“Legal ARgument Graph Observer”) that helps students identify, analyze, and reflect on episodes of hypothetical reasoning in oral argument transcripts. Using LARGO, students reconstruct examples of hypothetical reasoning in the oral arguments by representing them in simple diagrams that focus students on the proposed test, the hypothetical challenge to the test, and the responses to the challenge. The program analyzes the diagrams and provides feedback to help students complete the diagrams and reflect on the significance of the hypothetical reasoning in the argument. The article reports the results of experiments evaluating instruction of first year law students at the University of Pittsburgh using the LARGO program as applied to Supreme Court personal jurisdiction cases. The learning results so far have been mixed. Instruction with LARGO has been shown to help law student volunteers with lower LSAT scores learn skills and knowledge regarding hypothetical reasoning better than a text-based approach, but not when the students were required to participate. On the other hand, the diagrams students produce with LARGO have been shown to have some diagnostic value, distinguishing among law students on the basis of LSAT scores, posttest performance, and years in law school. This lends support to the underlying model of hypothetical argument and suggests using LARGO as a pedagogically diagnostic tool. (shrink)

This commentary suggests that the general population has much less reasoning skill than is claimed by Mercier & Sperber (M&S). In particular, many studies suggest that the skills of understanding, evaluating, and producing arguments are generally poor in the population of people who have not had specific training.

In this article I aim to use the 1948 Russell-Copleston debate to highlight some recent problems I have experienced teaching argument analysis in my philosophy courses. First, I will use argument diagramming to represent the arguments in the debate while reflecting on the use of this approach use to teach argument analysis skills. Then, I will discuss the tools and methods scholars have proposed to represent debates, rather than just individual arguments. Finally, I will argue that there is not, but (...) needs to be, a good way to represent argumentative debates in a way that neither obscures the essential details of the exchange nor becomes too unwieldy to extract a sense of the overall debate. (shrink)

Reasons.js is an open-source, loosely-coupled, web-based argument mapping library that can be integrated into a range of online coursewares and websites. The javascript library can be embedded into any HTML page and allows users to create, edit, share, and export argument maps . The API is designed to permit the integration of the three stages of informal logical analysis — identification of truth claims within arguments, the analysis of logical structure, and synthesis of logical structure into written form.

In response to the ever-increasing spread of online disinformation and misinformation, several human–computer interaction tools to enhance data literacy have been developed. Among them, many employ elements of gamification to increase user engagement and reach out to a broader audience. However, there are no systematic criteria to analyze their relevance and impact for building fake news resilience, partly due to the lack of a common understanding of data literacy. In this paper we put forward an operationalizable definition of data literacy (...) as a form of multidimensional critical thinking. We then survey 22 existing tools and classify them according to a framework of 10 criteria pointing to their gameful design and educational features. Through a comparative/contrastive analysis informed by a focus group, we provide a principled set of guidelines to develop more efficient human–computer interaction tools to teach how to critically think in the current media ecosystem. (shrink)

:This article examines privacy threats arising from the use of data mining by private Australian health insurance companies. Qualitative interviews were conducted with key experts, and Australian governmental and nongovernmental websites relevant to private health insurance were searched. Using Rationale, a critical thinking tool, the themes and considerations elicited through this empirical approach were developed into an argument about the use of data mining by private health insurance companies. The argument is followed by an ethical analysis guided by classical philosophical (...) theories—utilitarianism, Mill’s harm principle, Kant’s deontological theory, and Helen Nissenbaum’s contextual integrity framework. Both the argument and the ethical analysis find the use of data mining by private health insurance companies in Australia to be unethical. Although private health insurance companies in Australia cannot use data mining for risk rating to cherry-pick customers and cannot use customers’ personal information for unintended purposes, this article nonetheless concludes that the secondary use of customers’ personal information and the absence of customers’ consent still suggest that the use of data mining by private health insurance companies is wrong. (shrink)

External representations play a crucial role in learning. At the same time, cognitive load theory suggests that the possibility of learning depends on limited resources of the working memory and on cognitive load imposed by instructional design and representation tools. Both these observations motivate a critical look at Computer-Supported Argument Visualization tools that are supposed to facilitate learning. This paper uses cognitive load theory to compare the cognitive efficacy of RationaleTM 2 and AGORA.

Mercier & Sperber (M&S) claim that the phenomenon of belief bias provides fundamental support for their argumentative theory and its basis in intuitive judgement. We propose that chronometric evidence necessitates a more nuanced account of belief bias that is not readily captured by argumentative theory.

Mercier & Sperber (M&S) argue for their argumentative theory in terms of communicative abilities. Insights can be gained by extending the discussion beyond human reasoning to rodent and robot navigation. The selection of arguments and conclusions that are mutually reinforcing can be cast as a form of abductive reasoning that I argue underlies the construction of cognitive maps in navigation tasks.

Understanding the language of rejections and objections is an important part of the analysis and practice of argument. In order to strengthen this understanding, we might turn to diagramming, as it has been shown to have the virtue of improving critical thinking skills. This paper discusses what reliable meaning can be taken from words and phrases related to rejections and objections, and then how to diagram them.

This is a response essay to Donald Hatcher’s, “Critical Thinking Instruction: A Realistic Evaluation: The Dream vs. Reality.” Hatcher argues that critical thinking instruction seriously falls short of the ideal of honestly evaluating alternative evidence and arguments. This failure is apparent, he argues, when one surveys student performance on a variety of CT assessment tests. Hatcher reviews the current CT assessment data, which includes an extensive pool of results collected from Baker University where Hatcher oversaw a sophisticated and well-funded CT (...) program for about two decades. Hatcher also argues that evidence from the philosophical and psychological literatures on disagreement and judgment suggests even CT experts fail to model the ideal and that CT has suffered from an unrealistic conception of rationality and human decision-making. I reply by arguing that, by putting the CT assessment data in a different context and asking an alternative set of questions, one can justifiably derive a more positive evaluation of the future of CT instruction in light of the CT ideal. Instead of focusing on whether students are achieving the CT ideal by the time of the post-test, instructors should ask whether they are making the kind of progress that there is good reason to expect. I close by challenging the soundness of the proposed implications of Hatcher’s arguments. (shrink)

In this thesis, we introduce “Argueware”. This is a concept for an instructional group awareness tool which aims at supporting social interactions in co-located computer-supported collaborative argumentation settings. Argueware is designed to support the social interactions in the content and in the relational space of co-located collaborative argumentation. The support for social interactions in the content space of collaboration is facilitated with the use of collaborative scripts for argumentation as well with the use of an argument mapping tool. The support (...) for social interactions in the relational space of collaboration is facilitated with the use of different awareness mechanisms from the CSCL and the CSCW research fields. In this thesis, we examined how different awareness mechanisms facilitate the regulation of collaborative processes in the relational space of collaborative argumentation. Moreover, we studied how they affect the perceived team effectiveness and group performance in the content space of collaboration. Thereby, we studied also the effects of the design of the awareness mechanisms on the application of the mechanisms and the user experience with them. In line with the design-based research paradigm, we attempted to simultaneously improve and study the effect of Argueware on collaborative argumentation. Through a series of design-based research studies we tested and refined the prototypes of the instructional group awareness tool. Moreover, we studied the ecological validity of dominant awareness and instructional theories in the context of co-located computer-supported collaborative argumentation. The underlying premise of the Argueware tool is that a combination of awareness and instructional support will result in increased awareness of collaboration, which will, in turn, mediate the regulation of collaborative processes. Moreover, we assume that successful regulation of collaboration will result in high perceived team effectiveness and the group performance in turn. In the first phase of development of the Argueware tool, we built support of the content space of collaborative argumentation with argument scaffold elements in a pedagogical face-to-face macro-script and an argument mapping tool. Furthermore, we extended the use of the script for supporting the relational space of collaboration by embedding awareness prompts for reflecting on collaboration during regular breaks in the script. Following, we designed two variations of the same pedagogical face-to-face macro-script which differ with respect to the type of group awareness prompts they used for supporting the relational space of collaboration i.e. behavioral and social. Upon designing the two script variations, we conducted a longitudinal, multiple-case study with ten groups of Media Informatics master students where each group was conceptualized as a case. Students collaborated every time for arguing to solve one different ill-structured problem and for transferring their arguments in the argument mapping tool Rationale. Thereby, we intended to investigate the effects of different awareness prompts on collaborative metacognitive processes i.e., regulation, reflection, and evaluation the relation between collaborative metacognitive processes and the quality of collaborative argumentation as well as the impact of the two script variations on perceived team effectiveness and what was experience with the different parts of the script variations in the two groups and how this fits into the design framework by Buder. The quantitative analysis of argument outcomes from the groups yield no significant difference between the groups that worked with the BAS and the SAS variations. No significant difference between the script variations with respect to the results from the team effectiveness questionnaires was found either. Prompts for regulating collaboration processes were found to be the most successfully and consistently applied ones, especially in the most successful cases from both script variations and have influenced the argumentation outcomes. The awareness prompts afforded an explicit feedback display format through discussion. The prompted explicit feedback display format was criticized for running only on subjective awareness information on participation, contribution efforts and performance in the role. This resulted in evaluation apprehension phenomena and evaluation bias. The awareness prompts for reflection and evaluation did reveal frictions in the plan making process in the least successful groups. Problems with group dynamics but were not powerful enough to trigger the desired changes in the behaviors of the students. The prompts for evaluating the collaboration in both script variations had no apparent connection to argumentation outcomes. The results indicated that dominant presence phenomena inhibited substantive argumentation in the least successful groups. They also indicated that the role-assignment influenced the group dynamics by helping student’s making clear the labor division in the group. In the second phase of development of the Argueware tool, the focus is on structuring and regulating social interactions in the relational space of collaborative argumentation by means of scripted roles and role-based awareness scaffolds. We designed support for mirroring participation in the role and support for monitoring participation, coordination and collaboration efforts in the role. Moreover, we designed additional support for guiding participation in the role i.e., role-based reminders as notifications on smartwatches. In a between-subjects study, ten groups of three university students each worked with two variants of the Argueware for arguing to solve one ill-structured problem and transferring their arguments in the argument mapping tool Rationale. Next, to that, students should monitor their progress in their role with the role-based awareness visualization and the self-assessment questionnaire with the basic awareness support and the enhanced awareness support. Half of the groups worked only with the role-based awareness visualization and the self-assessment questionnaire while the other half groups received additional text-based awareness notifications via smartwatches that were sent to students privately. Thereby, we tested the use of different degrees of awareness support in the two conditions with respect to their impact on a) self-perceived awareness of performance in the role and of collaboration and coordination efforts, b) on perceive team effectiveness, c) group performance. We hypothesized that students in EAC will perform better thanks to the additional awareness reminders that increased the directivity and influenced their awareness in the role. The mixed methods analysis revealed that the awareness reminders, when perceived on time, succeeded in guiding collaboration. Students in the EAC condition improved their awareness over time. These results indicated that enhanced awareness support in the form of additional guidance through awareness reminders can boost the awareness of students’ performance in the role as well as the awareness of their coordination and collaboration efforts over time by directing them back to the mirroring and monitoring tools. Moreover, students in EAC exhibited higher perceived team effectiveness than the students in BAC. However, no significant differences in building of shared mental models or performing in mutual performance monitoring were found between the groups. However, students in BAC and EAC did not differ significantly with respect to the formal correctness or evidence sufficiency of their group argumentation outcomes. Moreover, technical difficulties with the smartphones used as delivery devices for the awareness reminders hindered the timely perception of the reminders and thus their effect on participation. Finally, the questionnaire on the experience with the different parts of Argueware system indicated the need for exploring further media for supporting the awareness reminders to avoid the overwhelming effects of the multiple displays of the system and enhancing higher perceptiveness of the reminders with low interruption costs for other group members. The rather high satisfaction with the use of the role-based awareness visualization and the positive comments on the motivating aspects of monitoring how the personal success contributes to the group performance indicate that the group mirror succeeded in making group norms visible to group members in a non-obtrusive way. The high interpersonal comparability of performances without moderating the group ‘s interaction directly in the basic awareness condition was proven to be the favored design approach compared to the combination of group mirror and awareness reminders in the enhance awareness condition. In the third phase of development of Argueware, we focused on designing and testing different notification modes on different ubiquitous mobile devices for facilitating the next prototype of a notification system for role-based awareness reminders. Thereby, the aim of the system was again to guide students’ active participation in collaborative argumentation. More specifically, we focused on raising students’ attention to the reminders and triggering a prompter reaction to the contents of the reminders whilst avoiding a high interruption cost for the primary task in the group. These goals were translated into design challenges for the design of the role-based awareness notification system. The system should afford low interruptions, high reaction and high comprehension of notifications. Notification systems with this particular configuration of IRC values are known as "secondary display" systems. Next, we designed three low-fidelity prototypes for a role-based notification system for delivering awareness reminders: The first ran on a smartwatch and afforded text-based information with vibration and light notification modalities. The second ran on smartphone and afforded text-based information with vibrotactile and light-based notification modalities. Finally, the third prototype run on a smart-ring which afforded graphical- based information with and light and vibration notification modalities. To test the suitability of these prototypes for acting as “secondary display” systems, we conducted a within-subjects user study where three university students argued for solving three different problem cases and producing an argument map in each of the three consecutive meetings in the Argueware instructional system. Students were assigned the roles of writer, corrector and devil`s advocate and were instructed to maintain the same role across the three meetings. In each meeting, students worked with a different role-based awareness notification prototype, where they received a notification indicating their balloon is not growing bigger after five minutes of not exhibiting any role-specific behaviors. The role-based awareness notification prototypes aimed at introducing timely interventions which would prompt students to check on their own progress in the role and the group progress as visualized by the role-based awareness visualization on the large display. Ultimately, this should prompt them to reflect on the awareness information from the visualization and adapt their behaviors to the desired behavior standards over time. Results showed that students perceived the notifications from all media mostly based on vibration cues. Thereby, the vibration cues on the wrist were considered the least disruptive to the main task compared to the vibration cues on finger and the vibration cues on the desk. Students also declared that vibration cues on wrist prompted the fastest reaction i.e., attending to notification by interacting with the smartwatch. These results indicate that vibration cues on the wrist can be a suitable notification mechanism for increasing the perceived urgency of the message and prompting the reaction on it without causing great distraction to the main task, as studies previous studies showed before. Based on very limited qualitative data on light as notification modality and awareness representation type no inferences could be made about its influence on the cost of interruption, reaction and comprehension parameters comprehensiveness. The qualitative and quantitative data on the experience with different media as awareness notification systems indicate that smartwatches may be the most suitable medium for acting as awareness notification medium with a “secondary display” IRC configuration. However, this inference needs to be tested in terms of a follow up study. In the next study, the great limitations of study need to be repaired. Finally, the focus should be on comparing notification modalities of one medium based on a larger set of participants and with the use of objective measurements for the IRC parameter values. Finally, we draw conclusions based on the findings from the three studies with respect to the role of awareness mechanisms for facilitating collaborative processes and outcomes and provide replicable and generalizable design principles. These principles are formed as heuristic statements and are subject to refinement by further research. We conclude with the limitations of the study and ideas for future work with Argueware. (shrink)