Just around 9:45 a.m. Pacific Time on February 28, 2017, websites like Slack, Business Insider, Quora and other well-known destinations became inaccessible. For millions of people, the internet itself seemed broken.
It turned out that Amazon Web Services was having a massive outage involving S3 storage in its Northern Virginia datacenter, a problem that created a cascading impact and culminated in an outage that lasted four agonizing hours.
Amazon eventually figured it out, but you can only imagine how stressful it might have been for the technical teams who spent hours tracking down the cause of the outage so they could restore service. A few days later, the company issued a public post-mortem explaining what went wrong and which steps they had taken to make sure that particular problem didn’t happen again. Most companies try to anticipate these types of situations and take steps to keep them from ever happening. In fact, Netflix came up with the notion of chaos engineering, where systems are tested for weaknesses before they turn into outages.
Unfortunately, no tool can anticipate every outcome.
It’s highly likely that your company will encounter a problem of immense proportions like the one that Amazon faced in 2017. It’s what every startup founder and Fortune 500 CEO worries about — or at least they should. What will define you as an organization, and how your customers will perceive you moving forward, will be how you handle it and what you learn.
We spoke to a group of highly-trained disaster experts to learn more about preventing these types of moments from having a profoundly negative impact on your business.
Reliability and uptime are so essential to today’s digital businesses that enterprise companies developed a new role, the Site Reliability Engineer (SRE), to keep their IT assets up and running.
Tammy Butow, principal SRE at Gremlin, a startup that makes chaos engineering tools, says the primary role of the SRE is keeping customers happy. If the site is up and running, that’s generally the key to happiness. “SRE is generally more focused on the customer impact, especially in terms of availability, uptime and data loss,” she says.
Companies measure uptime according to the so-called “five nines,” or 99.999 percent availability, but software engineer Nora Jones, who most recently led Chaos Engineering and Human Factors at Slack, says there is often too much of an emphasis on this number. According to Jones, the focus should be on the customer and the impact that availability has on their perception of you as a company and your business’s bottom line.
Someone needs to be calm and just keep asking the right questions.
“It’s money at the end of the day, but also over time, user sentiment can change [if your site is having issues],” she says. “How are they thinking about you, the way they talk about your product when they’re talking to their friends, when they’re talking to their family members. The nines don’t capture any of that.”
Robert Ross, founder and CEO at FireHydrant, an SRE as a Service platform, says it may be time to rethink the idea of the nines. “Maybe we need to change that term. Maybe we can popularize something like ‘happiness level objectives’ or ‘happiness level agreements.’ That way, the focus is on our products.”
Companies go to great lengths to prevent disasters to avoid disappointing their customers and usually have contingencies for their contingencies, but sometimes, no matter how well they plan, crises can spin out of control. When that happens, SREs need to execute, which takes planning, too; knowing what to do when the going gets tough.
Using a computer and modern software can be a chore to begin with for the visually impaired, but fundamentally visual tasks like 3D design are even harder. This Stanford team is working on a way to display 3D information, like in a CAD or modeling program, using a “2.5D” display made up of pins that can be raised or lowered as sort of tactile pixels. Taxels!
The research project, a collaboration between graduate student Alexa Siu, Joshua Miele and lab head Sean Follmer, is intended to explore avenues by which blind and visually impaired people can accomplish visual tasks without the aid of a sighted helper. It was presented this week at SIGACCESS.
The device is essentially a 12×24 array of thin columns with rounded tops that can be individually told to rise anywhere from a fraction of an inch to several inches above the plane, taking the shape of 3D objects quickly enough to amount to real time.
“It opens up the possibility of blind people being, not just consumers of the benefits of fabrication technology, but agents in it, creating our own tools from 3D modeling environments that we would want or need – and having some hope of doing it in a timely manner,” explained Miele, who is himself blind, in a Stanford news release.
Siu calls the device “2.5D,” since of course it can’t show the entire object floating in midair. But it’s an easy way for someone who can’t see the screen to understand the shape it’s displaying. The resolution is limited, sure, but that’s a shortcoming shared by all tactile displays — which it should be noted are extremely rare to begin with and often very expensive.
The field is moving forward, but too slowly for some, like this crew and the parents behind the BecDot, an inexpensive Braille display for kids. And other tactile displays are being pursued as possibilities for interactions in virtual environments.
Getting an intuitive understanding of a 3D object, whether one is designing or just viewing it, usually means rotating and shifting it — something that’s difficult to express in non-visual ways. But a real-time tactile display like this one can change the shape it’s showing quickly and smoothly, allowing more complex shapes, like moving cross-sections, to be expressed as well.
The device is far from becoming a commercial project, though as you can see in the images (and the video below), it’s very much a working prototype, and a fairly polished one at that. The team plans on reducing the size of the pins, which would of course increase the resolution of the display. Interestingly another grad student in the same lab is working on that very thing, albeit at rather an earlier stage.
The Shape Lab at Stanford is working on a number of projects along these lines — you can keep up with their work at the lab’s website.
The world of phone-based AR has involved a lot of promises, but the future that’s developed has so far been more iterative and less platform shift-y. For startups exclusively focused on mobile AR, there’s been some soul-searching to find ways to bring more lightweight experiences to life that don’t require as much friction or commitment from users.
8th Wall is a team focused on building developer tools for mobile AR experiences. The startup has raised over $10 million to usher developers into the augmented world.
The company announced this week that they’ve built a one-stop shop authoring platform that will help its customers create and ship AR experiences that will be hosted by 8th Wall . It’s a step forward in what they’ve been trying to build and a further sign that marketing activations are probably the most buoyant money-makers in the rather flat phone-based AR space at the moment.
The editor supports popular immersive web frameworks like A-Frame, three.js and Babylon.js. It’s a development platform, but while game engine tools like Unity have features focused on heavy rendering, 8th Wall is more interested in “very fast, lightweight projects that can be built up to any scale,” the startup’s CEO Erik Murphy tells TechCrunch.
8th Wall’s initial sell was an augmented reality platform akin to ARKit and ARCore that allowed to developers to build content that supported a wider breadth of smartphones. Today, 8th Wall’s team of 14 is focused on a technology called WebAR that allows mobile phones to call-up web experiences inside the browser.
The main sell of WebAR is the same appeal of web apps; users don’t need to download anything and they can access the experience with just a link. This is great for branded marketing interactions where expecting users to download an app is pretty laughable, moving this process to the web with a link or a QR code makes life much easier.
The startup’s cloud-based authoring and hosting platform is available now for its agency and
Kepler Communications, the Toronto-based startup that’s focused on developing and deploying shoebox-sized satellites to provide telecommunications services, is opening up registration for those interested in getting their first developer kits. These developer kits, designed to help potential commercial customers take advantage of its Internet of Things (IoT) narrowband connectivity deploying next year, will then be made available to purchase for elect partners next year.
This kind of early access is designed to give companies interested in using the kind of connectivity Kepler intends on providing a head start on testing and integration. Kepler‘s service is designed to provide global coverage using a single network for IoT operators, at low costs relative to the market, for applications including tracking shipping containers, railway networks, livestock and crops and much more. Kepler says that its IoT network, which will be made up of nanosatellites designed specifically for this purpose it plans to launch throughout next year and beyond, is aimed at industries where you don’t need high-bandwidth, as you would for say HD consumer video streaming, but where coverage across large, often remote areas on a consistent basis is key.
IoT connectivity provided by constellations of orbital satellites is an increasing are of focus and investment, as large industries look to modernize their monitoring and tracking operations. Startup Swarm got permission from the FCC to launch its 150-small satellite constellation earlierr this month, for instance, to establish a service to address similar needs.
Kepler, founded in 2015, has raised over $20 million in funding so far, and has launched two small satellites thus far, including one in January and one in November of 2018. The company announced a contract with ISK and GK Launch Services to deploy two more sometime in the middle of next year aboard a Soyuz rocket.
Facebook today announced it has filed suit in California against a domain registrar OnlineNIC and its proxy service ID Shield for registering domain names that pretend to be associated with Facebook, like www-facebook-login.com or facebook-mails.com, for example. Facebook says these domains are intentionally designed to mislead and confuse end users, who believe they’re interacting with Facebook.
These fake domains are also often associated with malicious activity, like phishing.
While some who register such domains hope to eventually sell them back to Facebook at a marked up price, earning a profit, others have worse intentions. And with the launch of Facebook’s own cryptocurrency, Libra, a number of new domain cybersquatters have emerged. Facebook was recently able to take down some of these, like facebooktoken.org and ico-facebook.org, one of which had already started collecting personal information from visitors by falsely touting a Facebook ICO.
Facebooks’ new lawsuit, however, focuses specifically on OnlineNIC, which Facebook says has a history of allowing cybersquatters to register domains with its privacy/proxy service, ID Shield. The suit alleges that the registered domains, like hackingfacebook.net, are being used for malicious activity, including “phishing and hosting websites that purported to sell hacking tools.”
The suit also references some 20 other domain names that are confusingly similar to Facebook and Instagram trademarks, it says.
OnlineNIC has been sued before for allowing this sort of activity, including by Verizon, Yahoo, Microsoft, and others. In the case of Verizon (disclosure: TechCrunch parent), OnlineNIC was found liable for registering over 600 domain names similar to Verizon’s trademark, and the courts awarded $33.15 million in damages as a result, Facebook’s filing states.
Facebook is asking for a permanent injunction against OnlineNIC’s activity as well as damages.
The company says it took this issue to the courts because OnlineNIC has not been responsive to its concerns. Facebook today proactively reports instances of abuse with domain name registrars and their privacy/proxy services, and often works with them to take down malicious domains. But the issue is widespread — there are tens of millions of domain names registered through these services today. Some of these businesses are not reputable, however. Some, like OnlineNIC, will not investigate or even respond to Facebook’s abuse reports.
Attorney David J. Steele, who previously won the $33 million judgement for Verizon, is representing Facebook in the case.
“By mentioning our apps and services in the domain names, OnlineNIC and ID Shield intended to make them appear legitimate and confuse people. This activity is known as cybersquatting and OnlineNIC has a history of this behavior,” writes Facebook, in an announcement. “This lawsuit is one more step in our ongoing efforts to protect people’s safety and privacy,” it says.
OnlineNIC has been asked for comment and we’ll update if it responds.
Motorcycle racing series Supercross isn’t quite ready to add an EV class.
The sport — where riders race high-performance machines on jump-filled stadium tracks — currently fields only gas-powered two-wheelers.
Supercross was poised to launch an all electric class this month, by converting its junior program to a new e-moto manufactured by KTM — Supercross Director of Operations Dave Prater told TechCrunch in April.
“We haven’t one-hundred-percented it yet, but it’s fairly close and we’re…going to race that electric KTM in October,” he said.
That won’t likely happen for the upcoming 2020 season, but input from Supercross and KTM indicates the launch of a junior EV class could be imminent.
On why it didn’t kick-off in October, “That would be a KTM question,” Prater told TechCrunch on a call this week.
“As a company we’re embracing EV racing. At the moment, we’re beholden to the OEM’s and how quickly they want to introduce it into the mix,” he added.
The first-mover OEM could still be KTM and the first electric class the juniors.
“The KTM Junior racing in Supercross is an incredible experience for a small group of kids and their parents. At some point we might start using the SX-E5,” KTM’s Group Marketing Manager for North America Tom Moen told TechCrunch in an email.
“We can’t have them racing something that is not readily available,” he added.
KTM’s SX-E5 launched in the U.S. this month, but won’t be available in dealerships until late November, according to Moen.
So for now, there appears to be a timing gap between Supercross and KTM.
Another area to watch for the introduction of e-moto competition — according to Moen — is outdoor dirt series Motocross, the rules of which (like Supercross) are governed by the American Motorcyclist Association (AMA).
“The AMA…is working on classes for the AMA Loretta Lynn’s championships for 2020, which is the national amateur MX series, the finals happen late summer, this is much more important racing wise,” Moen said.
TechCrunch has an inquiry into AMA for confirmation and will update accordingly.
One hurdle to entering electric motorcycles in AMA gas racing is how to classify battery powered two-wheelers compared to internal combustion engines that the AMA classes based on displacement, AMA off-road racing manager Erek Kudla explained to TechCrunch in April.
The other potentially larger hurdle (as Supercross’s Dave Prater alluded to) is the lack of an OEM produced competition e-moto capable of racing at or near the specs of the high-performance gas machines that run in Supercross and Motocross.
In addition to its junior SX-E5, KTM debuted its Freeride E-XC adult off-road e-motorcycle in the U.S. in 2018, but KTM didn’t indicate if this was the bike it was planning to reconfigure for motocross.
For the moment, it looks like seven to eight-year-olds racing KTM’s SX-E5 in Supercross could be the nearest bet for EV motorcycle competition.
And Supercross creating an all EV junior class has a spot of relevance in the overall transformation of global mobility — namely the conversion of the motorcycle industry to electric.
Factors such as declining sales among young people and competitive pressure from EV startups are pushing the big names toward E offerings. Harley Davidson launched its first e-moto, the $29K LiveWire, this year as part of a full EV pivot.
Harley and e-moto companies such as Zero have spoken of the importance of early adopters to embrace e-motorcycles. Harley made moves this year to reach the earliest of early adopters when it acquired kids e-bicycle company StaCyc.
Launching one of motorcycle racing’s first all electric classes with juniors and pairing it to Supercross’s stadium venues could become more than an EV gateway for OEM KTM.
It could actually start young riders on e-motos before they’ve ever ridden gas and keep them running on voltage into teen and adult years.
For the motorcycle industry at large, that means creating a future EV market vs. trying convert one with preferences set in fossil-fuel the past.
In the two years since Sidewalk Labs pitched its vision for a grand smart city development — encompassing an entire neighborhood on the Toronto waterfront — the project has been beset by controversy and criticism.
On one hand, the 12-acre project in Toronto’s Quayside district promised to be a proving ground for the latest thinking in sustainable design and technology integration into urban planning led by a subsidiary of one of the world’s most innovative technology companies. On the other, that same technology company has been instrumental in the development of a corporate, technologically enabled, panopticon that has an almost total view into our digital (and physical) lives through its search and mapping technology.
Giving that company the potential for unfettered access to the built environment in which Toronto citizens would move seemed like a step too far for many privacy advocates in the city and around the world.
The public outcry had gotten so loud that the project seemed to be in jeopardy. That, in turn, likely would be an existential challenge to Sidewalk Labs, since the company’s work in Toronto was to be the early crown jewel proving out its ability to integrate technology into the built environment in a way that would benefit populations, the company argued.
Now, the project will move forward. Sidewalk and Waterfront Toronto (the regulatory body overseeing the project) have come to an agreement that will limit the scope of the Sidewalk development and make the company work more closely with oversight agencies on the construction of the 12-acre parcel abutting Toronto’s parliamentary building.
“We are encouraged by today’s decision by the Waterfront Toronto board and are pleased to have reached alignment on critical issues with Waterfront Toronto. We want to be a partner with Waterfront Toronto and governments to build an innovative and inclusive neighborhood,” said Sidewalk Labs chief executive officer, Dan Doctoroff, in a statement.
Sidewalk is making some significant concessions to move forward. Under the initial plan that the company had submitted in June, it attempted to expand the scope of its development efforts beyond the initial 12-acres it had been bidding for. The company also wanted to be the lead developer of the land.
Instead, Sidewalk is acceding to the Waterfront Toronto counter-offer that it restrict its development to the 12-acre “beta site” initially carved out by the city. The company will also agree to work with Waterfront Toronto, which will lead a public procurement process for a developer to partner with Sidewalk Labs. Finally, Sidewalk Labs will also no longer lead the efforts to design and implement infrastructure. That’s now going to be handled by Waterfront Toronto.
“After two years in Toronto and engaging and planning with over 21,000 Toronto residents, we are looking forward to the next round of public consultations, entering the evaluation process, and continuing to develop a plan to build the most innovative neighborhood in the world. We are working to demonstrate an inclusive neighbourhood here in Toronto where we can shorten commute times, make housing more affordable, create new jobs, and set a new standard for a healthier planet.
One of the sticking points that the agreement between Sidewalk and the city doesn’t address is what’s going to be done with all of the data that the company will doubtless be collecting about the residents and visitors to this new intentional community.
Data privacy was one of the biggest concerns about the project. Indeed, at one point Sidewalk Labs proposed setting up an independent trust that would analyze and approve data collection in Quayside. The conflict between Sidewalk and its consultants drove one expert, Dr. Ann Cavoukian to step away from the work she was doing. Cavoukian wanted the data collection to be anonymized before it would be collected by any entity, and Sidewalk Labs was not willing to make that commitment on behalf of third parties.
Even with concerns over data collection, the experiment in urban planning has merit. Integrating technology to improve efficiencies in construction, energy generation, energy efficiency, traffic management and telecommunications could create a roadmap that other developments could follow. That’s a good thing. But those advancements should not come at the cost of an even greater erosion of personal privacy.
Ensuring that Sidewalk Labs can thread that needle in Toronto could actually improve the company’s chances to create a quilt of technologically advanced communities around the world.
The Daily Crunch is TechCrunch’s roundup of our biggest and most important stories. If you’d like to get this delivered to your inbox every day at around 9am Pacific, you can subscribe here.
Arguing that “internet political ads present entirely new challenges to civic discourse,” CEO Jack Dorsey announced that Twitter will be banning all political advertising — albeit with “a few exceptions” like voter registration.
Not only is this a decisive move by Twitter, but it also could increase pressure on Facebook to follow suit, or at least take steps in this direction.
Apple’s iPhone sales still make up over half of its quarterly revenues, but they are slowly shrinking in importance as other divisions in the company pick up speed.
More earnings news: Despite ongoing public relations crises, Facebook kept growing in Q3 2019, demonstrating that media backlash does not necessarily equate to poor business performance.
Hundreds of people who have taken the driver’s license test in Dehradun (the capital of the Indian state of Uttarakhand) in recent weeks haven’t had to sit next to an instructor. Instead, their cars were affixed with a smartphone that was running HAMS, an AI project developed by a Microsoft Research team.
Good news for our friends at Crunchbase, which got its start as a part of TechCrunch before being spun off into a separate business several years ago. CEO Jager McConnell also says the site currently has tens of thousands of paying subscribers.
The relationship between new management at G/O Media (formerly Gizmodo Media Group/Gawker Media) and editorial staff seems to have been deteriorating for months. This week, it turned into a full-on revolt over auto-play ads and especially a directive that Deadspin writers must stick to sports.
As we gear up for our Disrupt Berlin conference in December, we check in with top VCs on the types of startups that they’re looking to back right now. (Extra Crunch membership required.)
Album VC, a Lehi, Utah-based early-stage venture firm that’s been known until now as Peak Ventures, just gathered up $75 million in capital commitments for its third early-stage fund.
The development shows investor confidence in Album’s young team, which came together in 2014 after the founder of Zinch — a site connecting colleges and students that sold to the ed-tech company Chegg in 2011 — decided to try his hand at investing in other startups.
As that founder, Sid Krommenhoek — who stayed on with Chegg for several years, running its international efforts — explains it, “I thought I’d do another startup. But I also knew from our own experience in struggling to raise money the need for more capital in Utah, and I thought having that operator-entrepreneur perspective could be useful.”
A first fund, like many in the industry, was more of an experiment, though it was a decent $23 million, thanks largely to the support of Chegg CEO Dan Rosensweig, who was early to commit capital to the fund. A second, $56 million fund followed when Krommenhoek and John Mayfield — a friend who joined him from a marketing role at Qualtrics –began investing more seriously in their backyard and beyond.
They were soon joined by a third investor, Diogo Myrrha, who began as a principal with the firm and is now a general partner. Explains Krommenhoek of one of the many things that binds the three Brigham Young University grads, “We all came into Utah’s orbit when it wasn’t necessarily a place where you could live out your career, but that’s changed.”
Indeed, Album’s momentum — Krommenhoek claims they raised their new fund in one month’s time — also that underscores the continuing growth of the startup scene in Utah, where a growing number of home-grown companies have paid off in a big way for their backers creating new wealth that’s now being reinvested.
Album isn’t an investor in two of Utah’s biggest success stories Qualtrics and PluralSight, but it jumped early into two others that must have gotten its limited partners excited. One of these is Podium, a fast-growing, five-year-old, Utah-based company that helps businesses manage reviews and communicate with customers online and that has so far raised roughly $93 million, including from IVP, GV, and Accel. The other is Divvy, a three-year-old, Utah-based company that helps businesses manage payments and subscriptions, build strategic budgets, and eliminate expense reports. Divvy has already raised more than $250 million from investors, including New Enterprise Associates, Insight Partners, and Pelion Venture Partners.
As for how it will invest its newest capital pool, Krommenhoek says the idea is to invest in roughly 24 companies, roughly half of them in Utah, roughly half out of state. He also says the firm tends to fund more mature seed-stage deals, meaning companies that have moved past the paper-napkin phase and can prove that their product or service is gaining some early traction. That won’t change with this new fund, though the size of the average check will be slightly higher than in the past, ranging from $1 million to $1.5 million in exchange for at least 10 percent of a company. “We like to own double digits,” says Krommenhoek. “What we do at this stage doesn’t scale because human relationships don’t scale. You can only have a finite number of deep relationships.”
In terms of the firm’s areas of interest, Krommenhoek suggests these are broad but that Album — a name meant to hint at the firm’s collaborative nature — is most comfortable with software-as-a-service startups, marketplaces, and companies focused in some way on the future of work.
Above, from left to right John Mayfield (General Partner), Lisa Thomas (Engagement), Sid Krommenhoek (General Partner), Diogo Myrrha (General Partner) and Steve Hale (Operations).
A security researcher has found several vulnerabilities in the popular open-source Horde web email software that allow hackers to near-invisibly steal the contents of a victim’s inbox.
Horde is one of the most popular free and open-source web email systems available. It’s built and maintained by a core team of developers, with contributions from the wider open-source community. It’s used by universities, libraries, and many web hosting providers as the default email client.
Numan Ozdemir disclosed his vulnerabilities to Horde in May. An attacker can scrape and download a victim’s entire inbox by tricking them into clicking a malicious link in an email.
Once clicked, the inbox is downloaded to the attacker’s server.
But the researcher did not hear back from the Horde community. Security researchers typically give organizations three months to fix flaws before they are publicly disclosed.
NIST, the government department that maintains the national vulnerability database, said this week that the flaws pose a “high” security risk to users.
Ozdemir said some — though not all — of the vulnerabilities were recently fixed in the latest Horde webmail version. But the Horde community has not publicly acknowledged the vulnerability — or that users of earlier versions of the webmail are still vulnerable.
“It is really very easy to steal people’s email,” he told TechCrunch.
His bug report filed with Horde remains open at the time of writing. We emailed Horde several times, but did not hear back until after publication. Jan Schneider, a core developer on the project, said the vulnerabilities “have indeed been fixed, won’t be fixed, or didn’t even exist anymore at the time of the reporting.”