The ML community recognizes the importance of anticipating and mitigating the potential negative impacts of benchmark research. In this position paper, we argue that more attention needs to be paid to areas of ethical risk that lie at the technical and scientific core of ML benchmarks. We identify overlooked structural similarities between human IQ and ML benchmarks. Human intelligence and ML benchmarks share similarities in setting standards for describing, evaluating and comparing performance on tasks relevant to intelligence. This enables us (...) to unlock lessons from feminist philosophy of science scholarship that need to be considered by the ML benchmark community. Finally, we outline practical recommendations for benchmark research ethics and ethics review. (shrink)

The paper is a critique of Alvin Plantinga’s notion that belief in God is properly basic - evidence is not needed to justify such belief - in light of Thomas Aquinas’ religious epistemology. The latter’s epistemology proves that, while evidence is not a necessary condition for belief in God based on his Summa Theologica since such belief is evidence itself from his De Veritate, there is sufficient evidence that justifies such belief. First, I argue that Plantinga’s total rejection of evidence (...) as a justification for belief in God renders such belief purely subjective. To rationally ground this purely subjective belief, Plantinga introduces the notion of justification-conferring conditions. Second, following Thomas Aquinas’ thought, Plantinga’s justification negates his claim that belief in God is properly basic because the said justification-conferring conditions seem to function as an evidence for belief in God. I will conclude the work by claiming that although evidence is not a necessary condition for belief in God, it is epistemically sufficient to justify the said belief. (shrink)

In written and spoken communications, figures of speech (e.g., metaphors and synecdoche) are often used as an aid to help convey abstract or less tangible concepts. However, the benefits of using rhetorical illustrations or embellishments in visualization have so far been inconclusive. In this work, we report an empirical study to evaluate hypotheses that visual embellishments may aid memorization, visual search and concept comprehension. One major departure from related experiments in the literature is that we make use of a dual-task (...) methodology in our experiment. This design offers an abstraction of typical situations where viewers do not have their full attention focused on visualization (e.g., in meetings and lectures). The secondary task introduces “divided attention”, and makes the effects of visual embellishments more observable. In addition, it also serves as additional masking in memory-based trials. The results of this study show that visual embellishments can help participants better remember the information depicted in visualization. On the other hand, visual embellishments can have a negative impact on the speed of visual search. The results show a complex pattern as to the benefits of visual embellishments in helping participants grasp key concepts from visualization. (shrink)

In written and spoken communications, metaphors are often used as an aid to help convey abstract or less tangible concepts. However, the benefits of using visual metaphors in visualization have so far been inconclusive. In this work, we report an empirical study to evaluate hypotheses that visual metaphors may aid memorization, visual search and concept comprehension. One major departure from previous metaphor-related experiments in the literature is that we make use of a dual-task methodology in our experiment. This design offers (...) an abstraction of typical situations where viewers do not have their full attention focused on visualization (e.g., in meetings and classes). The use of the secondary task introduces “divided attention”, and makes the effects of visual metaphors more observable. In addition, it also serves as additional masking in memory-based trials. The results of this study show that visual metaphors can help participants better remember the information depicted in visualization. On the other hand, visual metaphors can have a negative impact on the speed of visual search. The results also show a complex pattern as to the benefits of visual metaphors in helping participants grasp key concepts from visualization. (shrink)