#algorithmic systems

by Damien

Over at AFutureWorthThinkingAbout, there is the audio and text for a talk for the  about how nonwestern philosophies like Buddhism, Hinduism, and Daoism can help mitigate various kinds of bias in machine minds and increase compassion by allowing programmers and designers to think from within a non-zero-sum matrix of win conditions for all living beings, meaning engaging multiple tokens and types of minds, outside of the assumed human “default” of straight, white, cis, ablebodied, neurotypical male:

My starting positions, here, are that, 1) in order to do the work correctly, we literally must refrain from resting in abstraction, where, by definition, the kinds of models that don’t seek to actually engage with the people in question from within their own contexts, before deciding to do something “for someone’s own good,” represent egregious failure states. That is, we have to try to understand each other well enough to perform mutually modeled interfaces of what you’d have done unto you and what they’d have you do unto them.” I know it doesn’t have the same snap as “do unto others,” but it’s the only way we’ll make it through.

[An image of a traditional Yin-Yang carved in a silver ring]

2) There are multiple types of consciousness, even within the framework of the human spectrum, and that the expression of or search for any one type is in no way meant to discount, demean, or erase any of the others. In fact, it is the case that we will need to seek to recognize and learn to communicate with as many types of consciousness as may exist, in order to survive and thrive in any meaningful way. Again, not doing so represents an egregious failure condition. With that in mind, I use “machine consciousness” to mean a machine with the capability of modelling a sense of interiority and selfness similar enough to what we know of biological consciousnesses to communicate it with us, not just a generalized computational functionalist representation, as in “AGI.”

For the sake of this, as I’ve related elsewhere, I (perhaps somewhat paradoxically) think the term “artificial intelligence” is problematic. Anything that does the things we want machine minds to do is genuinely intelligent, not “artificially” so, where we use “artificial” to mean “fake,” or “contrived.” To be clear, I’m specifically problematizing the “natural/technological” divide that gives us “art vs artifice,” for reasons previously outlined here.

The  overarching project of training a machine learning program and eventual AI will require engagement with religious texts (a very preliminary take on this has been taken up by Rose Eveleth at the Flash Forward Podcast), but also a boarder engagement with discernment and decision-making. Even beginning to program or code for this will require us to think very differently about the project than has thus far been in evidence.

So with the job of White House Office of Science and Technology Policy director having gone to Dr. Arati Prabhakar back in October, rather than Dr. Alondra Nelson, and the release of the "Blueprint for an AI Bill of Rights" (henceforth "BfaAIBoR" or "blueprint") a few weeks after that, I am both very interested also pretty worried to see what direction research into "artificial intelligence" is actually going to take from here.

To be clear, my fundamental problem with the "Blueprint for an AI bill of rights" is that while it pays pretty fine lip-service to the ideas of  community-led oversight, transparency, and abolition of and abstaining from developing certain tools, it begins with, and repeats throughout, the idea that sometimes law enforcement, the military, and the intelligence community might need to just… ignore these principles. Additionally, Dr. Prabhakar was director of DARPA for roughly five years, between 2012 and 2015, and considering what I know for a fact got funded within that window? Yeah.

To put a finer point on it, 14 out of 16 uses of the phrase "law enforcement" and 10 out of 11 uses of "national security" in this blueprint are in direct reference to why those entities' or concept structures' needs might have to supersede the recommendations of the BfaAIBoR itself. The blueprint also doesn't mention the depredations of extant military "AI" at all. Instead, it points to the idea that the Department Of Defense (DoD) "has adopted [AI] Ethical Principles, and tenets for Responsible Artificial Intelligence specifically tailored to its [national security and defense] activities." And so with all of that being the case, there are several current "AI" projects in the pipe which a blueprint like this wouldn't cover, even if it ever became policy, and frankly that just fundamentally undercuts Much of the real good a project like this could do.

For instance, at present, the DoD's ethical frames are entirely about transparency, explainability, and some lipservice around equitability and "deliberate steps to minimize unintended bias in Al …" To understand a bit more of what I mean by this, here's the DoD's "Responsible Artificial Intelligence Strategy…" pdf (which is not natively searchable and I had to OCR myself, so heads-up); and here's the Office of National Intelligence's "ethical principles" for building AI. Note that not once do they consider the moral status of the biases and values they have intentionally baked into their systems.

I’m Not Afraid of AI Overlords— I’m Afraid of Whoever's Training Them To Think That Way

by Damien P. Williams

I want to let you in on a secret: According to Silicon Valley’s AI's, I’m not human.

Well, maybe they think I’m human, but they don’t think I’m me. Or, if they think I’m me and that I’m human, they think I don’t deserve expensive medical care. Or that I pose a higher risk of criminal recidivism. Or that my fidgeting behaviours or culturally-perpetuated shame about my living situation or my race mean I’m more likely to be cheating on a test. Or that I want to see morally repugnant posts that my friends have commented on to call morally repugnant. Or that I shouldn’t be given a home loan or a job interview or the benefits I need to stay alive.

Now, to be clear, “AI” is a misnomer, for several reasons, but we don’t have time, here, to really dig into all the thorny discussion of values and beliefs about what it means to think, or to be a mind— especially because we need to take our time talking about why values and beliefs matter to conversations about “AI,” at all. So instead of “AI,” let’s talk specifically about algorithms, and machine learning.

Machine Learning (ML) is the name for a set of techniques for systematically reinforcing patterns, expectations, and desired outcomes in various computer systems. These techniques allow those systems to make sought after predictions based on the datasets they’re trained on. ML systems learn the patterns in these datasets and then extrapolate them to model a range of statistical likelihoods of future outcomes.

Algorithms are sets of instructions which, when run, perform functions such as searching, matching, sorting, and feeding the outputs of any of those processes back in on themselves, so that a system can learn from and refine itself. This feedback loop is what allows algorithmic machine learning systems to provide carefully curated search responses or newsfeed arrangements or facial recognition results to consumers like me and you and your friends and family and the police and the military. And while there are many different types of algorithms which can be used for the above purposes, they all remain sets of encoded instructions to perform a function.

And so, in these systems’ defense, it’s no surprise that they think the way they do: That’s exactly how we’ve told them to think.

[Image of Michael Emerson as Harold Finch, in season 2, episode 1 of the show Person of Interest, "The Contingency." His face is framed by a box of dashed yellow lines, the words "Admin" to the top right, and "Day 1" in the lower right corner.]

Much of my research deals with the ways in which bodies are disciplined and how they go about resisting that discipline. In this piece, adapted from one of the answers to my PhD preliminary exams written and defended two months ago, I "name the disciplinary strategies that are used to control bodies and discuss the ways that bodies resist those strategies." Additionally, I address how strategies of embodied control and resistance have changed over time, and how identifying and existing as a cyborg and/or an artificial intelligence can be understood as a strategy of control, resistance, or both. In Jan Golinski’s Making Natural Knowledge, he spends some time discussing the different understandings of the word “discipline” and the role their transformations have played in the definition and transmission of knowledge as both artifacts and culture. In particular, he uses the space in section three of chapter two to discuss the role Foucault has played in historical understandings of knowledge, categorization, and disciplinarity. Using Foucault’s work in Discipline and Punish, we can draw an explicit connection between the various meanings “discipline” and ways that bodies are individually, culturally, and socially conditioned to fit particular modes of behavior, and the specific ways marginalized peoples are disciplined, relating to their various embodiments. This will demonstrate how modes of observation and surveillance lead to certain types of embodiments being deemed “illegal” or otherwise unacceptable and thus further believed to be in need of methodologies of entrainment, correction, or reform in the form of psychological and physical torture, carceral punishment, and other means of institutionalization.

[(Locust, "Master and Servant (Depeche Mode Cover)"]

Below are the slides, audio, and transcripts for my talk '"Any Sufficiently Advanced Neglect is Indistinguishable from Malice": Assumptions and Bias in Algorithmic Systems,' given at the 21st Conference of the Society for Philosophy and Technology, back in May 2019. (Cite as: Williams, Damien P. '"Any Sufficiently Advanced Neglect is Indistinguishable from Malice": Assumptions and Bias in Algorithmic Systems;' talk given at the 21st Conference of the Society for Philosophy and Technology; May 2019) Now, I've got a chapter coming out about this, soon, which I can provide as a preprint draft if you ask, and can be cited as "Constructing Situated and Social Knowledge: Ethical, Sociological, and Phenomenological Factors in Technological Design," appearing in Philosophy And Engineering: Reimagining Technology And Social Progress. Guru Madhavan, Zachary Pirtle, and David Tomblin, eds. Forthcoming from Springer, 2019. But I wanted to get the words I said in this talk up onto some platforms where people can read them, as soon as possible, for a couple of reasons. First, the Current Occupants of the Oval Office have very recently taken the policy position that algorithms can't be racist, something which they've done in direct response to things like Google’s Hate Speech-Detecting AI being biased against black people, and Amazon claiming that its facial recognition can identify fear, without ever accounting for, i dunno, cultural and individual differences in fear expression? [Free vector image of a white, female-presenting person, from head to torso, with biometric facial recognition patterns on her face; incidentally, go try finding images—even illustrations—of a non-white person in a facial recognition context.] All these things taken together are what made me finally go ahead and get the transcript of that talk done, and posted, because these are events and policy decisions about which I a) have been speaking and writing for years, and b) have specific inputs and recommendations about, and which are, c) frankly wrongheaded, and outright hateful. And I want to spend time on it because I think what doesn't get through in many of our discussions is that it's not just about how Artificial Intelligence, Machine Learning, or Algorithmic instances get trained, but the processes for how and the cultural environments in which HUMANS are increasingly taught/shown/environmentally encouraged/socialized to think is the "right way" to build and train said systems. That includes classes and instruction, it includes the institutional culture of the companies, it includes the policy landscape in which decisions about funding and get made, because that drives how people have to talk and write and think about the work they're doing, and that constrains what they will even attempt to do or even understand. All of this is cumulative, accreting into institutional epistemologies of algorithm creation. It is a structural and institutional problem. So here are the Slides:



The Audio: … [Direct Link to Mp3] And the Transcript is here below the cut:

Below are the slides, audio, and transcripts for my talk "SFF and STS: Teaching Science, Technology, and Society via Pop Culture" given at the

2019 Conference for the Society for the Social Studies of Science, in early September

.

(Cite as: Williams, Damien P. "SFF and STS: Teaching Science, Technology, and Society via Pop Culture," talk given at the 2019 Conference for the Society for the Social Studies of Science, September 2019)

[audio mp3="http://www.afutureworththinkingabout.com/wp-content/uploads/2019/09/DPW4S2019-2.mp3"][/audio]

[Direct Link to the Mp3]

[Damien Patrick Williams]

Thank you, everybody, for being here. I'm going to stand a bit far back from this mic and project, I'm also probably going to pace a little bit. So if you can't hear me, just let me know. This mic has ridiculously good pickup, so I don't think that'll be a problem.

So the conversation that we're going to be having today is titled as "SFF and STS: Teaching Science, Technology, and Society via Pop Culture."

I'm using the term "SFF" to stand for "science fiction and fantasy," but we're going to be looking at pop culture more broadly, because ultimately, though science fiction and fantasy have some of the most obvious entrees into discussions of STS and how making doing culture, society can influence technology and the history of fictional worlds can help students understand the worlds that they're currently living in, pop Culture more generally, is going to tie into the things that students are going to care about in a way that I think is going to be kind of pertinent to what we're going to be talking about today.

So why we are doing this: Why are we teaching it with science fiction and fantasy? Why does this matter? I've been teaching off and on for 13 years, I've been teaching philosophy, I've been teaching religious studies, I've been teaching Science, Technology and Society. And I've been coming to understand as I've gone through my teaching process that not only do I like pop culture, my students do? Because they're people and they're embedded in culture. So that's kind of shocking, I guess.

But what I've found is that one of the things that makes students care the absolute most about the things that you're teaching them, especially when something can be as dry as logic, or can be as perhaps nebulous or unclear at first, I say engineering cultures, is that if you give them something to latch on to something that they are already from with, they will be more interested in it. If you can show to them at the outset, "hey, you've already been doing this, you've already been thinking about this, you've already encountered this, they will feel less reticent to engage with it."

……

We do a lot of work and have a lot of conversations around here with people working on the social implications of technology, but some folx sometimes still don't quite get what I mean when I say that our values get embedded in our technological systems, and that the values of most internet companies, right now, are capitalist brand engagement and marketing. To that end, I want to take a minute to talk to you about something that happened, this week and just a heads-up, this conversation is going to mention sexual assault and the sexual predatory behaviour of men toward young girls.