Dystopian Surveillance Is Becoming a Reality

(dallincrump.com)

134 points | by speckx 1 hour ago

21 comments

  • in_absentia 45 minutes ago
    Many geeks are the embodiment of the "don't trust the government" / "don't trust corporations" counterculture, but when equity grants entered the equation, we architected much of the modern techno-surveillance state. Flock is an YC company. Probably a quarter of the people who frequent this site work at Meta or Google.

    We're always eager to say how much we dislike it, but there's so little self-reflection in our community.

    • esseph 21 minutes ago
      > Probably a quarter of the people who frequent this site work at Meta or Google.

      No, lol

      That would make up between 0.3% and 0.5% of the global tech workforce, if you added all of their employees together.

    • moomoo11 36 minutes ago
      i mean do you want the honest answer? i’m not a white american guy so i can say it.

      importing hordes of foreign tech workers or hiring asians broadly whose culture is very much the opposite of “don’t tread on me” led to much of this.

      might not be comfortable to say but most of our tech companies are led by people who aren’t “Americana” (cultural)

      and broadly speaking, there are very few people like me (i’m asian) that value the American way of independence at all cost and most are just strivers and consumerist

      so the goal for most of them is to make 300k base and 300k stock per year. fuck the consequences.

      the days of making tech for the love of the game are long gone.

      • ultimafan 14 minutes ago
        Shame that people are down voting you, there's an uncomfortable truth to it I don't think people want to face.

        Culture is defined by people not borders- simply crossing an arbitrary line doesn't change someone's beliefs and values.

        The immigration boom especially on the West coast has vastly diluted assimilation into American culture- coming from an immigrant, who married into another family of immigrants- too many people move here and stick to their own cultural enclave, building a version of their home country in miniature instead of trying to integrate.

      • soraki_soladead 26 minutes ago
        the problem isn't the workers. plenty of "white american guys" with a "don't tread on me" culture share this goal. scapegoating "hordes of foreign tech workers or hiring asians broadly" ignores that the SV culture rewards this.

        > so the goal for most of them is to make 300k base and 300k stock per year. fuck the consequences.

        "What could be more American than that?" — Wadsworth, Clue (1985)

      • iugtmkbdfil834 32 minutes ago
        The fascinating part is that fuck the consequences was until more recently kinda penalized, but advent of tech overlords changed that calculus ( they even have their own saying to capture that 0.
        • moomoo11 29 minutes ago
          yes and it wasn’t always that way. most of these trends of the “god like” founder are maybe from the past 30 years.

          and it reeks of extractive personalities that took over

  • NishanStepak 4 minutes ago
    You can always assume permanent surveillance. Electromagnetic radiation can be read from a distance so any device is completely visible.
  • gblargg 1 hour ago
    > I don’t like the idea that anything I say in a public setting or in a conversation with others could end up in a transcript summary on someone’s personal device.

    Pretty minor if it's just that individual. But for certain this means there is a transcript on Apple's servers that can be subpoenaed by law enforcement, or sooner or later, searchable without a warrant.

    • lbrito 59 minutes ago
      It certainly will _not_ be just for that individual.

      Believing in that would be like believing web tracking is only ever used to "enhance your browsing experience".

    • edgyquant 51 minutes ago
      No it’s bad even for an individual why does someone I speak to need to ever have a transcript of our chat? I understand in a professional setting but if we’re just having a drink its weird
      • unregistereddev 36 minutes ago
        One intriguing use I encountered was a doctor who automatically transcribed the conversation during an appointment. This has HIPAA concerns, of course, and I think (hope, at least) that this was in the context of medical software that is designed to be HIPAA compliant. But it was an interesting way for a doctor to try and avoid missing something in conversation.

        I agree with you that it's weird outside of professional settings.

      • fragmede 47 minutes ago
        Because having a chat with you was special and I want to remember it but my aging fallible human brain is going to forget it, so I'd like to be able to remember it and hold on to and cherish that moment we shared.
        • paimapi 35 minutes ago
          "I want to replace the human experience with SQL queries" in a nutshell

          if chats are so important to you, write it down, with your hand. journaling is fun and great and there's evidence that it's good for your mental health because it allows you intentional time for introspection and insight-building

        • anigbrowl 13 minutes ago
          You're definitely going to forget it if you don't have to make any effort to remember it.
        • nyc_data_geek 45 minutes ago
          It's special because it's ephemeral.
        • epolanski 45 minutes ago
          Then write a note, stop recording me.

          If you can't be bothered, it wasn't that meaningful or important.

    • Byvrsakjo10 34 minutes ago
      Yeah, even with Meta glasses like those things record everything that the user sees, but the flock camera situation is really concerning their cameras are everywhere and I think they can also hear what people are saying
    • _fat_santa 51 minutes ago
      They would have to encrypt it in such a way where even if Law Enforcement went to apple with a subpoena, they would not be able to hand over that data at a technical level.

      The better way IMHO is use local models so data never actually leaves the device.

    • scotty79 55 minutes ago
      We really need to figure out how to encrypt everything on device with keys controlled by the owner of the device.
      • ethagnawl 46 minutes ago
        "We" could also just opt-out of purchasing/using all of this crap.
      • hkt 49 minutes ago
        Entirely technically feasible, and has been for years and years..

        ..but impossible to have unless you control the operating system that is distributed with phones that normal people will use.

      • generalizations 53 minutes ago
        "We"?
        • scotty79 50 minutes ago
          Yeah, we, the software developers.

          Any recordings should be kept in something akin to password manager.

          Heck, all of my data in any app should be kept in something like that.

          • generalizations 48 minutes ago
            Problem is, that's a hardware problem. Try asking Apple nicely to open their ecosystem; the appropriate expected response is, bring your own phone.

            That being said, I do actually expect that this stuff will (generally*) stay on-device. Apple's oddly good about that.

  • astrolx 1 hour ago
    The legal implications of these devices are just baffling. I see Meta glasses being sold where I live. The law states that you cannot photograph of film people without their consent, even in the street where there are other people around ...

    Now it will also be voice recording one has to be aware off ?

    Is that the AI future we want or need?

    • autoexec 1 hour ago
      > The law states that you cannot photograph of film people without their consent, even in the street

      What country do you live in? This is almost certainty not true in the US

      • dgellow 34 minutes ago
        Likely germany, we have very strict recording laws. It’s actually stricter on audio recording, due to Germany’s history: you’re not allowed to record people without their consent if they could expect privacy, which includes outside when for example 2 persons are talking to each others privately. That makes the meta glasses pretty much illegal to use in most situations, though I don’t believe that specific situation has been tested in court.

        Note how it’s about recording, not sharing.

        (It’s way more nuanced and complicated in practice of course)

      • GrinningFool 53 minutes ago
        • autoexec 27 minutes ago
          From that same link: "Two-party consent laws apply to private conversations where participants have a reasonable expectation of privacy."

          You have no reasonable expectation of privacy when you are in public or can be clearly heard from public. If you are "in the street" no one needs to get your permission to record you or what you say.

      • scotty79 51 minutes ago
        Maybe Germany?
  • bradgessler 56 minutes ago
    The solution is legal and political, not technical.
    • goda90 43 minutes ago
      We need all of the above, because it's too easy for the political winds to change and modify the laws to enable mass surveillance with a flip of a switch. It needs to be both illegal and technically hard to surveil people without their knowledge.
    • jrumbut 22 minutes ago
      The solution is all of the above and more.

      Every big problem needs to be addressed from multiple angles, whatever you can do, you can contribute to the solution.

    • kypro 36 minutes ago
      As a Brit I hope Americans understand just how amazing the first amendment is. Here in the UK (and Europe) surveillance can be used to criminalise us for things we say in private. At least in the US this kind of thing is much harder for the government to do.
  • autoexec 1 hour ago
    Cell phones are so useful that I'm not surprised that people are willing to bug themselves and their homes with them, but wearables offer so much less while being just as invasive. I suspect that people will take the bait anyway. I don't see very many "glassholes" running around though, and there was a lot of pushback against "friend" https://en.wikipedia.org/wiki/Friend_(product)
  • iugtmkbdfil834 59 minutes ago
    At this point, and I assure you I am not being contrarian -- you can check my post history, I would say just enjoy the ride man.
  • hackingonempty 57 minutes ago
    Just like running your own mail server doesn't help when nearly everyone you talk to uses GMail, simply not using these devices yourself is likely not to make much difference.
    • adiabatichottub 51 minutes ago
      We just have to make it the cool thing to run your own mail server. B-)
      • smalltorch 45 minutes ago
        I think it's cool, and completely necessary. No need to be compatible with old email, really.
  • HelloUsername 57 minutes ago
    "Audio Intelligence features are private by design, combining hardware, software, and services to protect user privacy in a way that only Apple can. These features do not create or store audio recordings, and raw audio used for processing is completely inaccessible to the operating systems, apps, the user, or Apple. By design, Audio Intelligence features do not identify and attribute speakers, to protect the privacy of both the user and those around them. Siri Recap produces a brief, high-level summary of conversations — not a transcript — and is designed to exclude sensitive information like financial information or government-assigned identifiers. Live Rewind text snippets and Siri Recap summaries are end-to-end encrypted in the Siri app with iCloud syncing, and are not accessible even by Apple. Read more about how Audio Intelligence protects privacy:" https://news.ycombinator.com/item?id=49632685
    • iAMkenough 53 minutes ago
      Notice how they focus on “audio recordings” specifically, meaning other types of recording (like transcripts used to generate summaries) are fair game.
    • nullc 52 minutes ago
      "We know our product is an unlawful violation of federal wiretap law since it will make zero-party-consent recordings, not that we care about violating the law at Apple because we know we can out spend anyone who would litigate against us, but we like to keep up appearances."
  • Shank 1 hour ago
    I've experimented with things like this, e.g., the Narrative Clip. I think the concept is quite novel and interesting, but the privacy implications are just far too gross for anything outside of an experiment. Of all companies, I find it appalling that it's Apple implementing this one.

    I don't even know how this is supposed to work e.g., in states with call recording legislation, let alone any new legislation. It feels utterly appalling that every Apple watch could theoretically be recording all surroundings now.

  • the_doctah 1 hour ago
    I watch "The First 48" religiously and its amazing how they go directly to Flock data in every new episode.
  • Create 44 minutes ago
    "The primary antagonist for freedom of thought in the beginning of our struggle was the Universal Catholic Church, an institution directed at the control of thought in the European world, based around weekly surveillance of the conduct and thoughts of every human being, based around the censorship of all reading material and in the end based upon the ability to predict and to punish unorthodox thought.

    The tools available for thought control in early modern Europe were poor even by 20th century standards, but they worked. And for hundreds of years, the struggle primarily centered around that increasingly important first mass manufactured article in Western culture: the book. Whether you could print them, possess them, traffic in them, read them, teach from them without the permission or control of an entity empowered to punish thought.

    By the end of the 17th century censorship of written material in Europe had begun to break down first in the Netherlands then in the UK then afterwards in waves throughout the European world and the book became an article of subversive commerce and began eating away at the control of thought.

    By the late 18th century that struggle for the freedom of reading had begun to attack the substance of Christianity itself and the European world trembled on the brink of the first great revolution of the mind. It spoke of “liberté, égalité, fraternité”, but actually it meant freedom to think differently." -- https://archive.org/details/EbenMoglenRepublica2012

  • CobrastanJorji 1 hour ago
    > I don’t like the idea that anything I say in a public setting...could end up in a transcript summary on someone’s personal device.

    My friend, if there's a reporter standing behind you, it could end up on the nightly news. And it's been that way forever. Certainly, a plethora of terrifyingly broad data collection greatly exacerbates the problem, but it's not a new problem.

    > bla bla bla...Amazon Echo...listening in on us without our knowledge or consent. I've lost track of how many times I've experienced or heard others...discussing a particular topic...and then as soon as they get on Facebook...they see posts and ads featuring the very topic they were discussing.

    There are lots of real problems with surveillance tech, but the stuff about smart speakers specifically is still a dumb conspiracy theory. People are CONSTANTLY testing the hardware in these things and watching network activity. They really are not listening to you, and blindly repeating this claim greatly harms your credibility.

    > bla bla bla...George Orwell envisioned in his dystopian novel 1984

    Okay, new rule, these articles need to pick at least one other dystopian novel. There are so many. What's wrong with Fahrenheigh 451, where the government had everyone look out their doors in a mass manhunt? That's a good one! Use it to talk about Ring cameras or something.

    • lbrito 57 minutes ago
      >My friend, if there's a reporter standing behind you, it could end up on the nightly news. And it's been that way forever.

      Can't tell if this is meant to be ironic or not. Are you seriously comparing a future consumer product to be potentially sold in the hundreds of millions with TV news reporters?

      That's the most HN spin I've seen this year

    • GrinningFool 1 hour ago
      > My friend, if there's a reporter standing behind you, it could end up on the nightly news

      It's a matter of scale. Now everybody with a device is a reporter.

      • tumdum_ 50 minutes ago
        It’s been 20 years since first iphone, this is nothing new. And somehow people are not recording everyone all the time.
        • anigbrowl 10 minutes ago
          Live streamers make a habit of doing this and are widely hated for it.
          • tumdum_ 5 minutes ago
            Exactly, they are *hated* for it. Afaik, I haven’t met anyone live streaming in my boring real life.
        • ux266478 43 minutes ago
          What is new is that now people will be recording everyone all the time, as a default.
          • tumdum_ 7 minutes ago
            That’s simply not possible with the announced Apple products. Afaict, Apple will let people save *transcripts* of last 15s and save *summaries* of transcripts.
    • dgoldstein0 58 minutes ago
      Re smart speakers / Google Assistant etc I think there have even been some lawsuits about inadvertent recording. I think they get it right most of the time, so my impression has been the lawsuits are about the mistakes.

      That all said, as a technologist in the past I could say "of course they aren't recording you and data mining your conversations" because that's obviously an expensive and complicated proposition when much cheaper forms of data mining exist. But with AI advancements I think that calculus could change - the systems that could do this are already being built for other reasons; the main reason to not do it is cost but that's being eroded.

    • usernomdeguerre 54 minutes ago
      Performative nitpicking is tiresome, why equivocate? Either you agree with the thrust of the argument and are looking to strengthen it, or you disagree. Which is it?
    • autoexec 39 minutes ago
      > the stuff about smart speakers specifically is still a dumb conspiracy theory

      We know for certain that they do listen to us even when they shouldn't and send that data https://www.techradar.com/news/your-smart-speaker-could-be-a...

      We also know that there have been multiple instances of employees and low paid contractors listening to people having sex and talking about very personal things.

      I don't think concerns over smart speakers spying on us qualifies as a "conspiracy theory". People looking for a conspiracy theory are better off digging into how this happened https://interestingengineering.com/innovation/amazon-alexa-c...

      If our devices were never listening to us in secret things like audio beacons wouldn't have been invented https://arstechnica.com/tech-policy/2015/11/beware-of-ads-th...

    • snoman 55 minutes ago
      > Certainly, a plethora of terrifyingly broad data collection greatly exacerbates the problem, but it's not a new problem.

      I argue that this is a false equivalence. When the scale of something changes by an order of magnitude (or multiples thereof), it’s no-longer the same problem/circumstance.

    • bad_haircut72 1 hour ago
      Every single time any article about how terrible things are / how its getting worse, someone always pipes in about how "this has always been a problem" - which is a completely useless observation that in practice only has the effect of normalizing the terribleness.
  • charcircuit 49 minutes ago
    >enabled could potentially be recorded without their knowledge or consent.

    The audio is not recorded.

    • Espressosaurus 46 minutes ago
      A realtime transcript—even abbreviated—is a recording.
  • nullc 55 minutes ago
    1960: "I have a great idea! lets have every person in the country carry a radio tracking beacon!" "That'll never fly!" 2012: "I can has TWO iphones??"
  • tsunamifury 56 minutes ago
    The core issue with mass, high detail survellance is 1) the chilling effect and 2) the construction of guilt effect

    When every single thing you do is put under a microscope you will be found guilty of nearly anthing. It will be possible to construct a believable number of crimes that you commited from circumstantial evidence and/or the pile of minor offenses citizens commit every day.

    The american system would defacto flip into "you are guilty, we just need to find out of what." and this becomes a way to control and witchhunt a population into silence and complaince.

  • epolanski 46 minutes ago
    The whole modern world is dystopian garbage.
  • FlockIsYC 1 hour ago
    [dead]
  • slipperybeluga 46 minutes ago
    [dead]
  • benzingtech 52 minutes ago
    Surveillance isnt a problem until people use it for personal gain
    • Windchaser 48 minutes ago
      > Surveillance isnt a problem until people use it for personal gain

      It absolutely can be a problem when used for organizational or ideological gain - e.g., when used by state, religion, business, or political group to spread propaganda, suppress opposition, unjustly favor an in-group, etc.

      The classic case of using mass surveillance to help a burgeoning theocratic or fascist state is a pretty standard example.

    • eranation 52 minutes ago
      People or AI...
    • atoav 45 minutes ago
      Yes but here is the catch. Surveillance comes with the incentives to us it for the personal gain. Or to phrase this differently: knowledge is power and thus the people who are already in power have good motivation to accumulate as much knowledge as possible in order to stay in power.

      It is very easy to take the philosophical stance where every concept can be totally detached from the incentives it creates and the social dynamics it is part of. It is easy to take that stance, but it is very hard to use that stance to explain reality, because reality plays by more complex rules.

      Please, always consider the status quo and the incentives involved instead of stating the surveillance equivalent of "weapons don't kill, people do".