Display https://smarterpatterns.com/ en Automated Alt Text https://smarterpatterns.com/patterns/281/automated-alt-text <span>Automated Alt Text</span> <div> <div>Application</div> <div><a href="/taxonomy/term/16" hreflang="en">Display</a></div> </div> <span><span>mattiealston</span></span> <span>Sat, 08/15/2020 - 00:00</span> <div> <div>Topic</div> <div><a href="/taxonomy/term/46" hreflang="en">Fairness &amp; Inclusiveness</a></div> </div> <div><p><b>Problem</b></p> <p>Users with vision impairments want to understand what image content exists in the interface. The system designers want to facilitate this without manually tagging alt text for every image.&nbsp;</p> <figure><img alt="A screenshot from Facebook showing how it has automatically tagged an image." data-entity-type="file" data-entity-uuid="632ee2e0-0080-4285-acba-503d1f521d25" src="/sites/default/files/content-images/Auto_alt_text_Facebook.png" style="width:100%" /> <figcaption>Facebook generates alt text as content tags, but also allows the user to edit these if needed.</figcaption> </figure> <p><b>Solution:</b></p> <p>Image recognition automatically tags images with alt text based on what the AI identifies in that image.</p> <p><b>Discussion:</b></p> <p>While the majority of patterns catalogued in this library are focused on the benefits to the user, in some cases, the value of AI may not be recognized by the end user but rather by those responsible for designing and maintaining the system. In this case, the primary users of alt text will care little how it is generated, as long as exists. Designers, on the other hand, should use patterns like this to broaden our ideas as to where data can be sourced from and ask which is the best approach in each case:&nbsp;from the initial uploader or content manager, crowdsourced across users, or generated by the system itself?</p> <p>Each has advantages as per the accuracy, authority,&nbsp; breadth and depth of the data created, but the AI approach is unique in terms of requiring the least human effort. That said, it doesn’t pay to be one hundred percent hands-off— automated content tags of any kind benefit from an additional layer of human intervention, where end users can ad-hoc moderate the data by flagging anything they believe is erroneous or offensive.&nbsp;</p> </div> Sat, 15 Aug 2020 00:00:00 +0000 mattiealston 281 at https://smarterpatterns.com Dataset Explorer https://smarterpatterns.com/patterns/201/dataset-explorer <span>Dataset Explorer</span> <div> <div>Application</div> <div><a href="/taxonomy/term/16" hreflang="en">Display</a></div> </div> <span><span>mattiealston</span></span> <span>Thu, 08/15/2019 - 00:00</span> <div> <div>Topic</div> <div><a href="/taxonomy/term/36" hreflang="en">Transparency &amp; Trust</a></div> </div> <div><p><b>Problem:</b></p> <p>The user wants to understand how the underlying data used in a system is structured, how extensive it is, and&nbsp;comprehend&nbsp;how it is used by the system.</p> <figure><img alt="A screenshot of the &quot;Infinite Drum Machine&quot; app showing datapoints clustered by similarity. " data-entity-type="file" data-entity-uuid="32a77257-aecf-40d9-a391-7923c3c79132" src="/sites/default/files/content-images/Dataset_explorer_Infinite_Drum_Machine_0.png" style="width:100%" /> <figcaption>The "Infinite Drum Machine" provides a playful way to explore the data (in this case different percussive sound samples clustered by audio similarity) .</figcaption> </figure> <p><b>Solution:</b></p> <p>Alongside the core functionality provided by the system, there is an extra feature that allows the user to dive into the data itself and explore it from different angles, using filters and other controls to manipulate it. This may utilize an attractive <a href="/patterns/206/dataset-visualization">Dataset Visualization</a> pattern as part of this interface, that can provide a playful interaction in its own right. Alternatively, it might be a simple list or table, which holds less appeal for casual explorers (and indeed may be very daunting for them to deal with) but empowers serious users to deepen their understanding of, and expertise with, the system.&nbsp;</p> <p><b>Discussion:</b></p> <p>For some applications, exploring a dataset can be the very point of the system, and plentiful examples of these can be found. For others, where there is a dataset “under the hood” powering operations, it might not increase the utility of the application to allow users to explore the data, but it can be very effective at building trust in the system by exposing its inner workings. In addition, it can provide a compellingly pleasurable “bonus feature” that can drive additional engagement.&nbsp;</p> <p><br /> <strong>More Examples:</strong></p> <figure><img alt="A screengrab of the dataset explorer functionality in the Fontjoy application." data-entity-type="file" data-entity-uuid="b2e963c7-16ec-43ea-bdad-a98b4ce8c606" src="/sites/default/files/content-images/data_explorer_Fontjoy.png" style="width:100%" /> <figcaption>In addition to the core&nbsp;font finding feature, Fontjoy provides a dataset explorer that enables a deep dive into everything the system knows about fonts.</figcaption> </figure> </div> Thu, 15 Aug 2019 00:00:00 +0000 mattiealston 201 at https://smarterpatterns.com Dataset Visualization https://smarterpatterns.com/patterns/206/dataset-visualization <span>Dataset Visualization</span> <div> <div>Application</div> <div><a href="/taxonomy/term/16" hreflang="en">Display</a></div> </div> <span><span>mattiealston</span></span> <span>Mon, 07/15/2019 - 00:00</span> <div> <div>Topic</div> <div><a href="/taxonomy/term/36" hreflang="en">Transparency &amp; Trust</a></div> </div> <div><p><b>Problem:</b></p> <p>The user wants to quickly understand the general shape of the dataset used by the system, the extent of it, and what patterns might exist within it.&nbsp;</p> <figure><img alt="A screengrab from the &quot;Living Archive&quot; app from Google showing a visualization of different dance moves." data-entity-type="file" data-entity-uuid="a6c1cd5d-f8bc-44cf-b56f-0414cbc43abc" src="/sites/default/files/content-images/Dataset_visualisation_Living_Archive2.png" style="width:100%" /> <figcaption>The "Living Archive" visualization from Google is an insightful and attractive way to explore the catalogue of dance moves from choreographer Wayne McGregor.</figcaption> </figure> <p><b>Solution:</b></p> <p>The system provides an attractive visualization that takes all the underlying data or a subset of it, and renders it into an easily comprehendible visual. This may be a static image&nbsp;or, if interactive, it may form part of a Dataset Explorer.</p> <p><b>Discussion:</b></p> <p>In general, users struggle to understand what it means when data powers a system, especially when the reality is that that data is just a list of abstract variables. Using a visualization to illustrate the nature of that data is an incredibly effective tool for helping users build a mental model of the system. In contrast to the Dataset Explorer pattern, where users want to understand and validate the data on a granular level, here even if that visualization is a big picture simplification or only portrays a small subset of data, it can still be a very valuable asset to share.</p> </div> Mon, 15 Jul 2019 00:00:00 +0000 mattiealston 206 at https://smarterpatterns.com Demonstrating Thinking https://smarterpatterns.com/patterns/151/demonstrating-thinking <span>Demonstrating Thinking</span> <div> <div>Application</div> <div><a href="/taxonomy/term/16" hreflang="en">Display</a></div> </div> <span><span>leighbryant</span></span> <span>Sat, 06/15/2019 - 00:00</span> <div> <div>Topic</div> <div><a href="/taxonomy/term/36" hreflang="en">Transparency &amp; Trust</a></div> </div> <div><p><strong>Problem:
</strong></p> <p>The user wants to know that the system has conducted a complex calculation. If the calculation occurs too quickly, they might not believe that the calculation has been completed correctly or has been extensive enough in considering all the variables.</p> <figure><img alt="Screenshot of the Articoolo application mid-way through an action" data-entity-type="file" data-entity-uuid="23d49df3-a717-4da7-8e57-19c49556e867" src="/sites/default/files/content-images/Articoolo.com_Progress_Edited_0.png" style="width:100%" /> <figcaption>The Articoolo app uses a progress bar and explanatory text to demonstrate the AI is "at work", so the user is given the sense that "thinking" is happening.</figcaption> </figure> <p><strong>Solution:
</strong></p> <p>The system uses artificial wait times and progress messages to demonstrate that it is "thinking" and applying satisfactory effort to the calculation.&nbsp;</p> <p><strong>Discussion:
</strong></p> <p>While simplicity in an interface is often desirable, in some cases the appearance of complexity may be beneficial, even to the point of simulating some of that complexity. While the reality of a system's intelligence may result in effortless calculations and speedy response times, the perception of a system's intelligence is ironically often associated with the appearance of effort and slower responses.&nbsp;
<br /> &nbsp;</p> </div> Sat, 15 Jun 2019 00:00:00 +0000 leighbryant 151 at https://smarterpatterns.com Dreamlike Novelty https://smarterpatterns.com/patterns/271/dreamlike-novelty <span>Dreamlike Novelty</span> <div> <div>Application</div> <div><a href="/taxonomy/term/16" hreflang="en">Display</a></div> </div> <span><span>mattiealston</span></span> <span>Wed, 05/15/2019 - 00:00</span> <div> <div>Topic</div> <div><a href="/taxonomy/term/36" hreflang="en">Transparency &amp; Trust</a></div> </div> <div><p><b>Problem:</b></p> <p>Sometimes the user wants to be surprised, to be hit with a joyous wave of weirdness that disrupts their everyday existence and makes them question whether they are awake or are dreaming the strangest of dreams. They also want to laugh at bizarre&nbsp;notions, such is the nature of absurdist humour.&nbsp;</p> <figure><img alt="A screenshot of the app &quot;Artbreeder&quot; showing some dreamlike imagery it has generated." data-entity-type="file" data-entity-uuid="1eaf22a0-6bf1-4a73-aa53-d443ba1e2b3c" src="/sites/default/files/content-images/Dreamlike_novelty_Artbreeder.png" style="width:100%" /> <figcaption>Artbreeder combines images of everyday objects to produce dreamlike creations.</figcaption> </figure> <p><b>Solution:</b></p> <p>Machine learning apps can often output strange results, whether accidentally or by design — the interface should embrace this freakiness and share this with the user. This can be in the form of generative text, imagery, or video.&nbsp;</p> <p><b>Discussion:</b></p> <p>Many of us long to be tourists in the world of the weird. Now we can be confronted with and delighted by such alien creativity as emerges from machine minds.&nbsp;We have constructed a gateway into the domain of dreams!&nbsp;</p> <p>The reality is that any machine learning tool is going to take odd paths regardless, so, where appropriate, make it a feature not a flaw to expose the oddities. Beware, though, that what one person considers to be charming Dreamlike Novelty, another may consider horrible <a href="/patterns/226/anti-pattern-nightmare-fuel">Nightmare Fuel</a>.</p> </div> Wed, 15 May 2019 00:00:00 +0000 mattiealston 271 at https://smarterpatterns.com Manual Overrides https://smarterpatterns.com/patterns/111/manual-overrides <span>Manual Overrides </span> <div> <div>Application</div> <div><a href="/taxonomy/term/16" hreflang="en">Display</a></div> </div> <span><span>leighbryant</span></span> <span>Fri, 06/15/2018 - 00:00</span> <div> <div>Topic</div> <div><a href="/taxonomy/term/41" hreflang="en">Autonomy &amp; Control</a></div> </div> <div><p dir="ltr"><b id="docs-internal-guid-542220bc-7fff-9025-dbfc-808af0dd3365">Problem:</b></p> <p dir="ltr">The system provides one or more AI-generated responses, but the user isn't happy with any of them.</p> <figure><img alt="Example of avatar creation flow featuring AI-generated and designer-generated options for users to choose from" data-entity-type="file" data-entity-uuid="bdcbab76-a3e5-4605-9a48-8a13a7998466" src="/sites/default/files/content-images/Manual_Overrides-avatars.png" /> <figcaption>An avatar-creation flow offers AI-generated solutions as well as pre-populated solutions created by a designer without the aid of AI.</figcaption> </figure> <p><strong>Solution:</strong></p> <p>In addition to dynamically generated AI-responses, the system provides a range of pre-made options not informed by AI to choose from.</p> <p><strong>Discussion:</strong></p> <p>Allowing designers to to pre-make alternate responses can be a useful addition to a system, since they're generally good at anticipating users' needs. There are a number of advantages to this approach: it's a good fallback if the AI fails to produce satisfactory quality; it can be a demonstration of the best of what the AI is capable of; and it allows the user to feel empowered choosing the AI-option knowing that they could otherwise opt out while still proceeding in the process.<br /> &nbsp;</p> </div> Fri, 15 Jun 2018 00:00:00 +0000 leighbryant 111 at https://smarterpatterns.com Progressive Processing Display https://smarterpatterns.com/patterns/51/progressive-processing-display <span>Progressive Processing Display</span> <div> <div>Application</div> <div><a href="/taxonomy/term/16" hreflang="en">Display</a></div> </div> <span><span>leighbryant</span></span> <span>Wed, 11/15/2017 - 00:00</span> <div> <div>Topic</div> <div><a href="/taxonomy/term/36" hreflang="en">Transparency &amp; Trust</a></div> </div> <div><p><strong>Problem:</strong></p> <p>While processing an image, the user wants to see the results as quickly as possible, even if that means only seeing part of the image completed.</p> <figure><img alt="Example of an image being loaded in segments to provide clarity sooner" data-entity-type="file" data-entity-uuid="2db162d8-1945-4c80-96be-9e91763adc1f" src="/sites/default/files/content-images/Progressive_Image_Processing_Grid-tensorzoom.png" /> <figcaption>An example of progressive processing display using a progressive image upload, which shows a grid with different sections coming in clearer as the AI processes.</figcaption> </figure> <p><strong>Solution:</strong></p> <p>The system processes and displays the image progressively, revealing greater detail or more sections as it is able to.</p> <p><strong>Discussion:</strong></p> <p>A pattern like this mitigates some of the issues around long processing times by providing an initial result in a shorter time, which ideally is enough of a preview for the user to choose to cancel if the output is undesirable. It also aids in transparency of operation by showing the algorithm in action rather than just the final output.<br /> &nbsp;</p> </div> Wed, 15 Nov 2017 00:00:00 +0000 leighbryant 51 at https://smarterpatterns.com Anti-Pattern: Nightmare Fuel https://smarterpatterns.com/patterns/226/anti-pattern-nightmare-fuel <span>Anti-Pattern: Nightmare Fuel</span> <div> <div>Application</div> <div><a href="/taxonomy/term/16" hreflang="en">Display</a></div> </div> <span><span>mattiealston</span></span> <span>Sun, 03/15/2015 - 00:00</span> <div> <div>Topic</div> <div><a href="/taxonomy/term/36" hreflang="en">Transparency &amp; Trust</a></div> </div> <div><p><b>Problem:</b></p> <p>An AI that generates imagery can be capable of producing some very unsettling material, especially when it combines otherwise innocent sources in unexpected ways. The user does not want to&nbsp;be freaked out by this.&nbsp;</p> <figure><img alt="A screenshot of the app &quot;Artbreeder&quot; showing some nightmarish imagery it has generated." data-entity-type="file" data-entity-uuid="1377d660-a85b-4c56-8585-58160abda8f8" src="/sites/default/files/content-images/Nightmare_fuel_Artbreeder.png" style="width:100%" /> <figcaption>Artbreeder combines images of innocent objects to produce horrible things.</figcaption> </figure> <p><b>Anti-Pattern Response:</b></p> <p>The system generates bizarre and disturbing imagery, which can include distorted faces, scary chimeras, unpleasant mutations, unsettling textures, terrifying landscapes, and so on — imagery that is better suited to a horror film, but can even&nbsp;surpass what the human imagination can conjure up on its own. In most cases, a system generates this imagery without much warning to the user that this is a possibility.&nbsp;</p> <p><b>Discussion:</b></p> <p>The capacity for AI imagery to unnerve us is immense but is often only discussed as a byproduct of AI’s ability to surprise us with its weirdness. If a system generates imagery and the intent is not to disturb, there are some very deep psychological responses that we should be aware of and avoid if possible, or at least caution the user about — at best there is a risk of negative reaction to the apparently familiar being twisted into dreamlike shapes, but at worst&nbsp;there can be a visceral repulsion, a nausea-inducing or otherwise deeply unpleasant sensation of wrongness.&nbsp;</p> <p>Of course, what we find desirable or not can be very subjective— what one person considers to be horrid Nightmare Fuel might be someone else’s pleasurable <a href="/patterns/271/dreamlike-novelty">Dreamlike Novelty</a>.</p> </div> Sun, 15 Mar 2015 00:00:00 +0000 mattiealston 226 at https://smarterpatterns.com