• Теги
    • избранные теги
    • Разное423
      • Показать ещё
      Компании762
      • Показать ещё
      Страны / Регионы156
      • Показать ещё
      Международные организации45
      • Показать ещё
      Издания89
      • Показать ещё
      Люди87
      • Показать ещё
      Формат21
      Показатели17
      • Показать ещё
      Сферы8
19 января, 16:10

Oracle (ORCL) Faces Lawsuit on Labor Discrimination Charges

Oracle Corporation (ORCL) is facing allegations over its hiring and rewarding practices.

Выбор редакции
18 января, 16:10

jl-sql: работаем с JSON-логами в командной строке с помощью SQL

Вступление никому не интересно, поэтому начну сразу с примеров использования % cat log.json {"type": "hit", "client": {"ip": "127.1.2.3"}} {"type": "hit", "client": {"ip": "127.2.3.4"}} {"type": "hit", "client": {"ip": "127.3.4.5"}} {"type": "hit", "client": {"ip": "127.3.4.5"}} {"type": "hit", "client": {"ip": "127.1.2.3"}} {"type": "click", "client": {"ip": "127.1.2.3"}} {"type": "click", "client": {"ip": "127.2.3.4"}} Выполняем запрос: % cat log.json | jl-sql 'SELECT client.ip, COUNT(*) AS count WHERE type = "hit" GROUP BY client.ip' {"client":{"ip":"127.1.2.3"},"count":2} {"client":{"ip":"127.2.3.4"},"count":1} {"client":{"ip":"127.3.4.5"},"count":2} Читать дальше →

Выбор редакции
17 января, 16:59

[Из песочницы] Глубокое обучение с подкреплением виртуального менеджера в игре против неэффективности

Об успехах Google Deepmind сейчас знают и говорят. Алгоритмы DQN (Deep Q-Network) побеждают Человека с неплохим отрывом всё в большее количество игр. Достижения последних лет впечатляют: буквально за десятки минут обучения алгоритмы учатся и выигрывать человека в понг и другие игры Atari. Недавно вышли в третье измерение — побеждают человека в DOOM в реальном времени, а также учатся управлять машинами и вертолетами. DQN использовался для обучения AlphaGo проигрыванием тысяч партий в одиночку. Когда это ещё не было модным, в 2015 году, предчувствуя развитие данного тренда, руководство Phobos в лице Алексея Спасского, заказало отделу Research & Development провести исследование. Необходимо было рассмотреть существующие технологий машинного обучения на предмет возможности использования их для автоматизации победы в играх управленческих. Таким образом, в данной статье пойдёт речь о проектирование самообучающегося алгоритма в игре виртуального управленца против живого коллектива за повышение производительности. Читать дальше →

14 января, 21:02

Debunking Loretta Lynch's One-Sided 'Chicago Cops Are Racist Villains' Statistics

Is it fake news when on MLK weekend Loretta Lynch issues a scorching 164 page report blasting Chicago police for using force on Blacks 10 times more often then Whites... but nowhere mentioning that Blacks are murdered 15 times more often than Whites, or that Blacks are the murders 20 times more often than Whites, or that Police are 30 times more often to be killed by a Black than by a White? Seems like a shot in the face at Jeff Sessions and a gift to BLM and civil rights leaders, in the final hour... Statistical Ideas' blog's Salil Mehta exposes the one-sided statistics outgoing AG Loretta Lynch used to villify Chicago Cops... Outgoing Attorney General for the Department of Justice, Loretta Lynch, has distributed an environmentally-friendly, 164-page report that finds (after a year-long investigation) that my hometown Chicago Police Department "engages in a pattern or practice of using force, including deadly force, in violation of the Fourth Amendment of the Constitution."  The longwinded defense glosses over critical statistics to allow any reader to truly understand what is at the nucleus of their most scorching claim against the Chicago Police.  That in addition to economic hardships for minorities (and is that 100% essential?), police use excessive force 10 times more often against Blacks as they do against Whites.  And that's a deceptive headline shocker, which combined with selective data-mining, simply states what they feel is obvious with their constituents across the country.  The leaders of the Black Lives Matter movement joined other civil rights groups in responding lockstep with the findings, demanding "we are not going to take it any more".  What does that mean?  Are the big concerns in life that (Chicago) police are simply villains?  Life would be coziest if they used kids’ gloves?  And why were these groups righteously hushed in recent months, as Blacks were multiple times caught on video group-assaulting Whites who "may have voted for Trump"?  Look at the top of the chart -below- which shows this 10x rate for Blacks versus Whites, when it comes to use of excessive police force.  Now we'll discuss some other self-computed statistics that should be considered, and which were not provided as meaningful background.   “more often” This naughty expression incorrectly implies that each Black criminal is subject to 10 times as much excessive police force as each White criminal.  But that's a false trap.  The actual statistics, for the few who cared to look at them, show that simply the overall population of Blacks saw 10 times more excessive use of force versus the overall population of Whites. Blacks are a small minority It is true that in the United States there are nearly five times as many Whites as there are Blacks (put differently, there is 0.2 Blacks per White).  So it would be arousing to incorrectly deduct that while there is 0.2 Blacks per White, there is nearly 10 times as many Blacks experiencing excessive force versus Whites.  Recall we are discussing the U.S. here.  Instead we must drill down to just The Windy City: and there we see an equal number of Blacks versus Whites.  Blacks are not a small minority at all.  And let's hold on to this 1:1 statistic as we go through some other relevant settings information below. who is getting murdered Even though there is one Black per White in Chicago, there are nearly 15 murdered Blacks per murdered White.  It's not the Chicago Police Department killing these Blacks, and certainly not White civilians.  We should note that in 2016 Chicago Mayor Emmanuel, former Obama Chief of Staff, oversaw the largest number of homicides in Chicago, in the past two decades!  These murders are one of the primary reasons that Chicago isn't anymore a top 100 places to live, and it sees great emigration of its citizens to other parts of the U.S.  Including people who want to be police officers.  And with strained municipal and state budgets and fearing their own life, the Chicago Police Department have to bring justice to whoever is killing all of these Blacks (happening at a rate of nearly a dozen weekly).  It’s unfortunately a treasured, yet sometimes unappreciated job. who is doing the murdering Without surprise but part of the probability data, Blacks are committing these record murders across Chicago (even under a Democratic leader and with their unemployment rate falling to cyclical lows).  Butchering at 20 times the rate of Whites!  So while the population is equally split between Blacks and Whites, the Department of Justice (DOJ) report chose to fleece us from the fact that Blacks accounts for 20 times as many of the city's slayings (instead only highlighting the policy focus of Blacks experience 10 times as much use of excessive force).  As appalling as these levels of excessive uses of force against Blacks are, we need to also appreciate that the Chicago Police (as a demographic segment) are >30 times more likely to be killed by a Black, then any other demographic segment killing any other (in chart below, see these drivers of the current 5-year national record-slaughtering of police).  It should be part of this report and not a random result but from the most statistically significant predictive factors such as: the nature of the suspect in relation to others at the scene, the age difference between the suspect and police, and how this same suspect interacts with police when approached. Now given all of this context above, wouldn't you precisely conclude that there should be some balanced compassion for the Chicago Police?  Even if not, understand that police have their supporters who don’t feel Whites deserve to experience excessive force in equal number as Blacks, even if see less violent crime.  This absurd measure of executing violent criminal justice is unhinged, even though we have the same number of brash disparagers against the police, anyway.   Though we should equally note that nothing in here proves that the Chicago Police have executed their public duties in a racially fair way.  Minorities deserve to feel more at ease in their own homes and communities.  It's just that showcasing one-sided statistics, as the DOJ did here, is clearly more confrontational and less likely to be embraced. All of this mortality science has been brought up earlier (here, here) and in a couple high-profile, peer-review academic research articles on race within the police ranks (one of which I was the journal editor for).  Though it is worth noticing here every time we get untrue violent justice statistics put forward.  This final-hour parting gesture by Attorney General Lynch fall squarely into that category, and one the new successor (perhaps President-elect Trump's nominee Jeff Sessions) is entitled to handle differently. Mortality probability math is very tough, as shown in our calm debunk of an Oxford University research paper, which they then immediately and mortifyingly redacted with Erratas.  Though the teachings are often the same and are worth reminding ourselves of, every time the occasion arises.

14 января, 15:08

Book Bits |14 January 2017

● A Good Disruption: Redefining Growth in the Twenty-First Century By Martin Stuchtey, et al. Summary via publisher (Bloomsbury) Disruptive technology is one of the defining economic trends of our age, transforming one major industry after another. But what is the true impact of such disruption on the world’s economies, and does it really have […]

12 января, 15:21

Peter Thiel: I won't take a job with Trump's administration

Peter Thiel, the billionaire venture capitalist who donated more than a million dollars to President-elect Donald Trump’s campaign and serves on his transition team, would not accept a job in the incoming administration if offered one, he told the New York Times.“Confirm,” Thiel said in an interview published Wednesday when asked if it’s true that there is no administration job that could lure him to Washington. “I want to stay involved in Silicon Valley and help Mr. Trump as I can without a full-time position.”While the PayPal co-founder has said he would not join the White House in an official capacity, he has played an active role in Trump’s transition process, most notably arranging a Trump Tower meeting last month between the president-elect and some of the nation’s most prominent tech executives, including Apple’s Tim Cook and Facebook’s Sheryl Sandberg. Amazon CEO Jeff Bezos and Elon Musk, the head of SpaceX and Tesla, both attended as well despite their criticism of Trump during the campaign.Thiel also spoke at the Republican National Convention last July, discussing during his remarks that he is gay, a first for the GOP event. The billionaire told the Times that he drew more criticism from the liberal gay community than from Christians for speaking at the RNC and that overall, “Trump is very good on gay rights.” The president-elect is unlikely to reverse any of the progress the gay community has made in recent years, Thiel said, adding that he would “obviously be concerned if I thought otherwise.”Throughout his campaign, but especially during the Republican primary, Trump campaigned hard on his promise to ban temporarily Muslims from entering the U.S., a position he has since backed away from. Executives from multiple tech companies have preemptively said that they would not assist the Trump administration in the creation of any Muslim registry system. Asked if the data-mining company he helped found would be willing to help the Trump administration build such a registry, Thiel told the Times: “We would not do that.”

Выбор редакции
09 января, 03:44

С чего начать внедрение Hadoop в компании

Алексей Еремихин ( alexxz ) Я хочу навести порядок в головах, чтобы люди поняли, что такое Hadoop, и что такое продукты вокруг Hadoop, а также для чего не только Hadoop, но и продукты вокруг него можно использовать на примерах. Именно поэтому тема — «С чего начать внедрение Hadoop в компании?» Структура доклада следующая. Я расскажу: какие задачи я предлагаю решать с помощью Hadoop на начальных этапах, что такое Hadoop, как он устроен внутри, что есть вокруг него, как Hadoop применяется в Badoo в рамках решения задач с первого пункта. Читать дальше →

06 января, 13:30

Why the French Email Law Won’t Restore Work-Life Balance

A new law establishing workers’ “right to disconnect” went into effect in France on January 1 of this year. The law requires companies with more than 50 employees to establish hours when staff should not send or answer emails. In an interview with the BBC, French legislator Benoit Hamon described the law as an answer to the travails of employees who “leave the office, but they do not leave their work. They remain attached by a kind of electronic leash — like a dog.” We all know intuitively that we are more connected to the workplace than ever before. When Bain & Company examined e-communications and other forms of collaboration at two dozen large global companies, we found that the time devoted to email, instant messaging (IM), crowdsourcing, and other online communications is extensive and, unfortunately, on the rise. We used Microsoft Workforce Analytics (formerly VoloMetrix) and other data mining tools to comb through information captured in Microsoft Outlook, Gmail, and similar applications to understand precisely how much time is dedicated to processing e-communications — that is, sending, reading, and responding to email, IM, and other messages. What we found confirmed what many of us have long suspected, namely: Senior executives now receive 200 (or more) emails per day. The average frontline supervisor devotes about eight hours each week — a full business day — to sending, reading and answering e-communications. The level of e-communication has grown every year since 2008 (the year we started examining this data), and much of it now creeps into off-hours and weekends. Of the eight hours managers devote to e-communications each week, we estimate 25% of that time is consumed reading emails that should not have been sent to that particular manager and 25% is spent responding to emails that the manager should never have answered. Stated differently, the average frontline supervisor devotes almost half a day each week to processing unnecessary e-communications. There is nothing an individual employee can do to combat this onslaught. Neglect too many emails or IMs, and you risk irritating your peers or, worse, your boss. And if sending endless email chains is the way your organization gets things done, then you have no real choice but to adopt the ways of the tribe. In short, excessive e-communication is an organizational problem. It demands organizational solutions. While the intent of France’s new law is laudable, rules like this confuse effect with cause, and as a result probably will not slow the tide of e-communication. At best, these measures will merely shift the timing of workplace communications from off-hours to the workday and push other “work” to weekends and after hours. In short, government officials can tell employers that they should not expect employees to respond to e-communications during off-hours, but unless the need — or perceived need — for excessive email, IM, crowdsourcing, and the like is somehow addressed, no government mandate will have much of an impact on the total time devoted to e-communications by employees or supervisors. Indeed, the French may quickly discover that their most productive workers are routine “lawbreakers” who stay connected during off-hours to reduce the need to take time away from family and friends to complete other work-related tasks. The only way to decrease the total time dedicated to e-communications is to encourage leaders and employees to manage the load they put on the organization through email, IM, and so on. In our work with clients, we have come to believe that the best way to do this is to provide real-time information to leaders regarding organizational load, defined as the total hours devoted to reading and responding to emails originating from each executive. The leadership team at Seagate, for example, found that merely providing information on the total load each manager generated each week compared to peer executives helped to reduce unnecessary e-communications. Internal competition encouraged leaders to reduce the number of employees copied on each email as well as the responses they sent to emails that did not require one. Combined, these actions reduced the time devoted to processing e-communications, without the need for mandates. Information alone modified management’s behavior. Another simple but powerful action is to eliminate “Reply All” — figuratively or literally. Since it takes time to read any email, even those that are unnecessary or not intended for you, the Reply All feature can be a big time waster. In the organizational time audits we described earlier, we found that Reply All being so easy to use costs the average frontline supervisor more than 30 minutes a week in processing unnecessary e-communications. Eliminate the feature and you will liberate unproductive time across the organization. There is little doubt that unnecessary e-communications is costly, not just to the individual employee but to society at large. It contributes to employee burnout and lost productivity. But legal mandates focused on the symptoms, rather than the cause, of excessive emails are likely to have little effect. It’s time for leaders to take responsibility for the load they put on the organization and to take steps to change the way work gets done on the job. Only then will employees be able to successfully cut the leash and focus their precious time on delivering great results.

Выбор редакции
03 января, 07:58

[Перевод] Тренируем нейронную сеть написанную на TensorFlow в облаке, с помощью Google Cloud ML и Cloud Shell

В предыдущей статье мы обсудили как натренировать чат-бот на базе рекуррентной нейронной сети на AWS GPU инстансе. Сегодня мы увидим, как легко можно обучить такую же сеть с помощью Google Cloud ML и Google Cloud Shell. Благодаря Google Cloud Shell не нужно будет делать практически ничего на локальном компьютере! Кстати, сеть из прошлой статьи мы взяли лишь для примера, можно спокойно брать любую другую сеть, которая использует TensorFlow. Читать дальше →

02 января, 02:30

Clif High-2017 Predictions on Everything

 Internet data mining expert Clif High uses calls what he does “Predictive Linguistics,” to mine the Internet and collects billions of data points to produce forecasts of the future. High has predictions on Trump, gold, silver, housing, stocks, bonds, the dollar, interest rates and even new... [[ This is a content summary only. Visit http://FinanceArmageddon.blogspot.com or http://www.figanews.com/ or http://goldbasics.blogspot.com for full links, other content, and more! ]]

Выбор редакции
31 декабря 2016, 10:42

Школа Данных «Билайн»: с Наступающим

Итак, заканчивается 2016 год. Для нас он был очень активным. Было 6 выпусков нашего курса для аналитиков, 5 выпусков курса для менеджеров (Data-MBA). Мы запустили курс в Санкт-Петербурге и уже провели первый выпуск. В партнерстве мы также обучали студентов Высшей Школы Экономики и Российской Экономической Школы, проводили мастер-классы в Сколково, участвовали в десятках хакатонов по всей стране, консультировали ведущие компании касательно применения аналитики и монетизации данных. В этом году один из наших преподавателей стал первым в мире в рейтинге Kaggle. Читать дальше →

Выбор редакции
28 декабря 2016, 12:41

Классификаторы: анализ активности посетителей сайтов

1. Вступление Данная заметка рассказывает о некоторых аспектах практического применения классификаторов в системах анализа активности посетителей сайтов. Показаны примеры кода для задач машинного обучения, которые активно применяются как для глобального анализа статистики в интернет, так и для локальных задач классификации поведенческих факторов на крупных порталах. Читать дальше →

Выбор редакции
27 декабря 2016, 05:36

Kaggle: Allstate Claims Severity

Хотелось бы описать решение к недавнему соревнованию по машинному обучению Allstate Claims Severity. (Мой результат 40 из 3055). Так как это это соревнование типа «ансамблевое рубилово», как правило, обсуждение решений вызывает нездоровые священные войны между теми, кто пробовал участвовать и теми кто нет, так что для начала я сделаю небольшое лирическое отступление. Читать дальше →

Выбор редакции
23 декабря 2016, 17:46

Traders (Too) Confident Santa Claus Coming To Town

Via Dana Lyons' Tumblr, Shorter-term stock volatility expectations have dropped to their lowest levels in more than 4 years. We’ve covered the term structure of stock volatility indices on several occasions. This, again, refers to the relationship between the various durations, e.g., 8-day, 1-month, 3-month, represented by these indices. The concept is that when nearer volatility indices trade at a historically high extreme versus indices further out, it can signal too much fear on the part of traders and set the stage for a potential rally. Conversely, when near-term volatility expectations become extremely depressed relative to longer-term, it can signal too much complaency and the potential for weakness in the stock market. That latter condition may be present now. As recently as late July, we mentioned the relationship between the 1-month volatility index (VIX) and the 3-month (VXV). At the time, the VIX/VXV ratio had dropped to .76 for just the 4th unique time ever. We hinted that it may be a red flag for stocks as they had historically struggled in the short to intermediate-term after similar low ratio readings. The VIX/VXV would remain depressed for much of the next month, leading to a moderate pullback into the election. Well, following the post-election rally, complacency is back. Today, the VIX/VXV ratio closed at  .7469, the 4th lowest reading ever and the lowest since August 2012. Here is the updated chart from the July post showing historically low readings since the inception of the VXV in 2007.   As the chart shows, the .779 level (data-mined to be sure) had been somewhat of a threshold marking extreme lows, with just 13 such readings prior to July (the chart begins in 2012 as there were no occurrences before then). Since July, there have been no fewer than 24 readings below .779. So we need to continue to monitor what really qualifies as “extreme”. Nonetheless, stocks generally did poorly after that July-August period until after the election so let’s stay with the .779 level for purposes of this post. Before July, the 13 historical readings had seen the S&P 500 lower 3 months later every single time. With the plethora of readings since July, that record is no longer unanimous, but this recent evidence is still consistent with too much complacency in the stock market. Let’s look at the updated results.   Again, while the 3-month returns may not be unanimously negative following the signals, they are consistently so. The vast majority of the signals from July to September resulted in lower 2-month and 3-month returns, as was historically the case. And even the handful of September readings that saw the post-election rally boost their 2 and 3-month returns into positive territory suffered at least 4% drawdowns along the way. So through the fall, this signal continues to be a consistent red flag for stocks in the shorter intermediate-term. On the bright side, the negative ramifications have not historically stretched beyond that time frame. Indeed, while we don’t yet have 6-month returns for the post-July period, all 13 VIX/VXV readings below .779 prior to this year saw the S&P 500 higher 6 months later. So while the term structure of stock volatility indices presently suggests too much complacency in the market, the risk has typically manifested itself most in the 2 to 3-month period. Therefore, even if that weakness comes to pass, it doesn’t preclude further gains in the longer-term. Nor, by the way, does it preclude a Santa Claus Rally over the next few weeks. However, it does suggest that whatever presents Santa might bring to stock traders may eventually get returned. *  *  * More from Dana Lyons, JLFMI and My401kPro.

Выбор редакции
23 декабря 2016, 17:40

[Из песочницы] Исследование датасета с IMDB

Проблематика Фильмы — это круто, фильмы вдохновляют нас, наполняют уверенностью, в общем дают нам многое. И поэтому в этой статье я бы хотел рассказать вам об исследовании тенденций современного кинематографа с помощью инструментов анализа данных, который уже был презентован в финале Science Slam ITMO University 2.0. Полный выпуск доступен здесь. Читать дальше →

Выбор редакции
23 декабря 2016, 11:23

Топ-10 ключевых анонсов от Microsoft в 2016 году

Традиционно провожаем уходящий 2016 год подборкой ключевых анонсов от корпорации Microsoft. Под катом мы собрали десять самых ярких и запоминающихся новостей. Читать дальше →

Выбор редакции
22 декабря 2016, 13:43

Еще 12 big data кейсов

Хабр, привет. Сегодня мы подготовили еще 12 примеров того, как технологии больших данных приносят компаниям деньги. Читать дальше →

20 декабря 2016, 23:05

13 Ways Policy And Politics Stole Your Privacy In 2016

OMG! 2016 will go down as one of the worst years ever -- in countless ways... and I'm not talking about the "real" world here -- that's another article altogether. I'm referring to our digital world 2016. While some of us in the tech industry have made progress, we continue to encounter atrocious violations that halt real, transformative change, especially in the privacy department. The following list is of 2016's top privacy and security violations, and if these don't already keep you up at night (probably because more often than not, no one was reporting on them!), they will by the time you finish reading them. As Edward Snowden put it: "I don't want to live in a society that does these sort of things... I do not want to live in a world where everything I do and say is recorded. That is not something I am willing to support or live under." I don't either, Ed! So, let these atrocities serve as our motivation to take personal action and end our support for violators, demand better laws to protect us, and join apps and networks that eliminate corporate and 'Big Brother' surveillance! 1. WhatsApp Sells Out WhatsApp originally prided itself on privacy. Then it got bought by Facebook. Close to one year later, WhatsApp announced that, under its new terms and conditions, it will now track and share your activity on the app (who you are talking to, when, where you are, for how long, etc.) and your personal information (your phone number and everything else they know about you) and even more -- with its parent company, Facebook. That's right, just in case you forgot, Facebook owns WhatsApp. WhatsApp claimed that these changes were in the best interest of the user (fighting spam and increasing business-to-consumer communication). Since when is sacrificing your privacy in your own best interest? 2. Uber Takes Users For a Ride Uber updated its app to track users' locations even when they're not using the app. Uber spun the move as data collection and analysis for improving the pickup and drop-off experience. That's questionable thinking, but scarier is the precedent such an action takes, suggesting this practice is okay. It's not. Earlier this year, Uber also had to pay a $20,000 fine to the FTC for providing unauthorized third-party access to drivers' personal information and using aerial tracking to identify riders. Let's hope that such actions don't become the Uber norm. 3. Android's Data Backdoor to China We all know that Google tracks the location, text messages, and call logs of its devices users. What we didn't know until recently was that information went not only to Google, but also to a mysterious server in China. To make matters worse, the backdoor used for the practice comes through pre-installed monitoring software, meaning it's not malware or a security breach. It's part of the device! According to the "New York Times", American authorities don't know if the data is being collected for advertising purposes or government surveillance. That's not very comforting. 4. Fitbit Fiasco 2016 saw a surge in fitness trackers, which while a helpful resource, revealed a lack of data protection. That's because the Health Insurance Portability and Accountability Act, better known as HIPAA, protects sensitive patient data according to the world as we knew it in 1996. These regulations predate mobile devices and the common use of the internet. Now in the 21st century, we're learning there's little online protection of our health information. Basically you share everything with products from companies such as Fitbit and in return they sell it to advertisers. We should be in control of our medical profiles and our personal fitness habits. 5. Pokémon Go - Your Data is Theirs Pokémon Go became a worldwide phenomenon, but at what price? A big hub-bub arose about Pokémon Go's full functionality requiring access to a user's entire Google account on iOS, including your location data, email and browsing history. How's that for an overreach? How else do you think Google can help you find a Squirtle or Caterpie near you? Pokémon Go has to mine where you go, how you get there, and how long you stay. But your email? That's bizarre and creepy. Other location apps such as Foursquare and Tinder do the same thing, as does Facebook. Pokémon Go however, can do it to a level no other app ever has before as they monitor every step, literally. That's not the kind of gameplay we need to be encouraging. The game is great. The privacy behind it is non-existent and a black hole for your "permanent record" as they store, monitor and perhaps even sell what you've been up to, naughty or nice. 6. SnapChat's Private Eyes Are Watching You Glasses help us put the world into focus. SnapChat's Spectacles help us survey, record and post that view, without the permission of those caught on video. With one simple tap, ten seconds of someone's soul gets automatically uploaded onto the recorder's account. If that sounds disturbing, it's only because it is. Generation Z is willingly the most recorded generation in history. But even they would be less likely to express themselves freely or be true to themselves if they felt they were being recorded at all times. Such technology is invasive and impedes innovation. Remember Google Glass - people don't want this stuff. When we see creepy privacy-violating technology right in front of our face, we recoil! Let's reject this bad idea. 7. China Sets Your Social Score Late this year, the Chinese government introduced a system that connects citizens' financial, social, political and legal credit ratings to create a social score -- as if the citizens of the Communist nation weren't monitored enough already. Then Facebook openly and willingly offered to provide every tidbit of data on their Chinese members and censor news on its site so that the Communist nation would let the social media app back into the country. In western democracies, such blatant actions would be a clear violation of citizen's basic rights and freedom of speech. Yet Facebook is willing to table all democratic laws because the Chinese market it's trying to capture isn't beholden to them. Soulless at its worst. Seriously, at what point does Facebook draw the line in a sand that even it won't cross? No soul, no ethics, no line. 8. Facebook Fakes Journalism Back in May, we learned that trending news on Facebook was controlled and edited by people - who were capable of discerning real news from fake news. It seems this particular team overreached a bit and also did some news manipulation - why is this a surprise? Forget privacy here - Facebook spies on its members and assigns political labels to them based on what they see them do. This led to an uproar when conservatives discovered that stories in line with their beliefs were being suppressed by liberal-leaning editors. No matter where you stand on the political spectrum, this is first a remarkable privacy violation, and second, incredible censorship. We aren't supposed to censor or filter real news on social media. Then Facebook fired their "fake news" filtering team to appease the conservatives. Of course humans still programmed the algorithms - so this was just a distracting nod to the right. What was the result? Facebook's algorithms boosted and spread fake headlines and news stories, distorting reality and very likely changing the election outcome in the USA. 9. Death by Algorithm Algorithms used to be equations assigned to math books. Time travel used to be the fodder of science fiction. Now social media sites and search engines use algorithms to change the order of time. This year saw major sites such as Facebook and Instagram radically change algorithms, which changes everyone's news feeds. In other words, your news feeds and timelines aren't shown to you in real time - the algorithms of Facebook, Snapchat, Instagram and Twitter manipulate them - to display posts and content they think you want to see. A lot of people aren't happy with this and for good reason. Part of the fun of these apps is that we get to see what people are doing or saying or what's happening in the actual real life moment. Algorithms take that away. They ruin relevancy and introduce delay. News feeds are meant to be objective, yet these equations make them subjective. And that subjectivity comes from mining through what we do online. So in the end, we get violated twice, by the invasion of privacy and the control of what we see, what we don't see, and when we see it. 10. Racial Profiling & User Surveillance Earlier this year, Twitter, Facebook and Instagram were called out by the California branch of the ACLU for sharing user data with a social media monitoring tool that tracks activists' conversations. That isn't very democratic. Even worse, the product can be manipulated to target activists of color, which has forced some Black Lives Matter activists off of social media and underground. Not good. Facebook similarly got called out in 2016 for letting advertisers exclude specific "Ethnic Affinities," which the company unveiled by collecting facts about users likes and friends. This is not only totally racist, but it also violates federal law. The Fair Housing Act of 1968 and the Civil Rights Act of 1964 detail how you can't exclude people based on race, gender, print notices or ads that show preferences or limitations based on the same criteria. Facebook must have missed that civics lesson. 11. U.S. Government's Back Door Demand Our federal government tried to make Apple open a backdoor so it could peruse information in a suspect's smartphone. Apple CEO Tim Cook became a privacy advocate/hero fighting back. A lawsuit looked inevitable, until the government said it found a way on its own to achieve the same end goal. Rather than end the debate, I think such an announcement is dynamite to the whole subject. If our government can bypass manufacturers in one instance, then what stops it from doing it over and over again? Devices are a convenience meant to keep us connected to people and our content. Turning them into evidence against ourselves or a confessional platform endangers the future of us and our technology. 12. Yahoo's 1, 2, 3 - The Ultimate Fiasco (1) In September, Yahoo announced that 500 million user accounts had been breached and the data within them compromised. That alone would make for a bad year. (2) But then in November, word leaked that Yahoo had allowed U.S. intelligence agencies to read through its user emails in search of red flag phrases or keywords. Everything users have written suddenly available to be held against them in a court of law -- as part of their "permanent record," that nasty electronic dossier that lives forever in the hands of those who watch. It was an egregious violation of epic proportions and a perfect end to Yahoo's year, until of course Yahoo reported at year's end that (3) one billion user accounts had been hacked back in 2013. Yes, within one calendar year, Yahoo had managed to achieve the holy grail of incompetence: three epic acts of privacy ineptitude. What is going on at Yahoo!? 13. England's Snooper Charter Yes, even the UK has co-opted reasonable privacy mores. Officially known as The Investigatory Powers Act 2016, the Snooper Charter in many ways gives UK police and spy agencies a carte blanche for keeping tabs on citizens. It supports the legalization of global surveillance, data collection, government hacking, decryption, data mining of emails and app activity and as the cherry on top, monitoring all internet browsing -- the good, the bad, and the none of your business. Edward Snowden called it "The most extreme surveillance in the history of western democracy." While most of these invasive actions will require a warrant, don't expect a lot of pushback from a government requesting permission from itself to spy on its population. So, what can YOU do about all of this? It's clear that there are several large perpetrators and everything you do at Facebook, Google, Snapchat, etc., is stored in your online permanent record: what you like, your politics, your partying, your religion, your health issues, who you are friends with, what you say... and now it all affects your ability to get a job, get into school, get a bank loan -- basically everything. How is this ok? It's NOT. There is no evidence that mass spying eradicates terrorism, and mass spying is exactly the antithesis to the democratic freedoms our ancestors fought and won World Wars for. It's time for all of us to take personal action and end our support for privacy violators, demand better laws to protect our privacy rights, and join apps and networks that eliminate unnecessary corporate and 'Big Brother' surveillance! See any 2016 privacy violations missing? Join in the conversation at: #WORSTyear4privacy -- This feed and its contents are the property of The Huffington Post, and use is subject to our terms. It may be used for personal consumption, but may not be distributed on a website.

Выбор редакции
16 декабря 2016, 13:53

Как мы запускали программу Deep Learning

Хабр, привет. Как вы знаете, для обучения глубоких нейронных сетей оптимально использовать машины с GPU. Наши образовательные программы всегда имеют практический уклон, поэтому для нас было обязательно, чтобы во время обучения у каждого участника была своя виртуальная машина с GPU, на которой он мог решать задачи во время занятий, а также лабораторную работу в течение недели. О том, как мы выбирали инфраструктурного партнера для реализации наших планов и подготавливали среду для наших участников, и пойдет речь в нашем посте. Читать дальше →

Выбор редакции
16 декабря 2016, 10:39

[Перевод] Chatbot на базе рекуррентной нейронной сети своими руками за 1 вечер/6$ и ~ 100 строчек кода

В данной статье я хочу показать насколько просто сегодня использовать нейронные сети. Вокруг меня довольно много людей одержимы идеей того, что нейронки может использовать только исследователь. И что бы получить хоть какой то выхлоп, нужно иметь как минимуму кандидатскую степень. А давайте на реальном примере посмотрим как оно на самом деле, взять и с нуля за один вечер обучить chatbot. Да еще не просто абы чем а самым что нинаесть ламповым TensorFlow. При этом я постарался описать все настолько просто, что-бы он был понятен даже начинающему программисту! В путь! Читать дальше →

06 июля 2016, 13:17

Поисковые системы: Google vs Яндекс

Гости Игорь Ашманов, управляющий партнёр компании «Ашманов и партнёры», Сергей Панков, генеральный директор Ingate Digital Agency, Дмитрий Завалишин, основатель и генеральный директор DZ Systems Подпишитесь на канал РБК: http://www.youtube.com/user/tvrbcnews?sub_confirmation=1 ------------------------ Получайте новости РБК в социальных сетях: Facebook: https://www.facebook.com/rbc.ru Twitter: https://twitter.com/ru_rbc ВКонтакте: https://vk.com/rbc Одноклассники: http://ok.ru/rbc