The words engineering and sports aren’t usually used in the same sentence, and the two activities usually don’t happen in the same room. But they were, and they did, last week at the DARPA Spectrum Challenge, held at the Defense Advanced Research Projects Agency headquarters in Arlington, Va.
The goal of the contest, the first ever DARPA challenge on the use of spectrum, was to demonstrate how a software-defined radio can use a given communication channel in the presence of other users and interfering signals. Over the course of two days, normally taciturn techies oohed, aahed, and cheered as 18 teams competed in a series of head-to-head matches to see who had the best algorithms.
A nearly yearlong process winnowed an initial field of 90 teams down to the 18 that competed last month. While most of the teams were composed of academics, there were also amateur hobbyists, including a medical doctor whose second love is electronics and a 28-year-old contract programmer with no formal education beyond high school.
Software-Defined Radio’s Dark Horses
The teams that competed in the DARPA Spectrum Challenge were not all academics and professional engineers. Here are two independents that made it to the finals.
Team KPE was the brainchild of Kevin Rosenberg, M.D., 52, who has been an electronics hobbyist since age 11. He started building his own radios and then moved to computers, building a Z80-based system from spare parts. Even while in medical school, Rosenberg kept up with electronics. In 1983, he developed a computer tomography simulator based on open-source software (you can see it at CTSim.org). In addition to his work at a hospital (he’s board certified in emergency medicine, internal medicine, and metabolic medicine), Rosenberg has a consulting practice developing medical software and embedded hardware. He thought the Spectrum Challenge would be a good way to learn more about software-defined radio, but he says he never expected to make it to the finals. His primary goal, he says, “was to learn and enjoy interacting with like-minded folks.”
Team Wasabi was a self-taught 28-year-old hacker named Marc Newlin. A 2003 high school graduate, Newlin does contract programming and consulting in addition to his day job at a small Florida marketing company. In 2011, Newlin entered DARPA’s Shredder Challenge—a competition to figure out how to reassemble shredded documents—and placed third. He kept an eye out for other DARPA challenges, and when the Spectrum Challenge was announced in 2013, he signed up. Newlin didn’t know anything about software-defined radio or signal processing, he says, but his success in the Shredder Challenge gave him confidence. He found the Spectrum Challenge very rewarding. “As somebody who didn’t go to college, the ability to compete against teams from research institutions is not something that happens every day,” he says.
The challenge was actually two separate competitions. In one tournament, two teams in each match competed to send and receive 15 000 packets on a 5-megahertz-wide channel centered at 600 MHz within the UHF band. This was an adversarial contest, where one team was allowed, even encouraged, to try to interfere with the other team’s broadcast. This type of adaptive radio technology is appropriate for military applications—on a battlefield, for example—where the enemy is trying to jam transmissions. In this contest, the first team to successfully transmit and receive all their packets won and moved on to the next round. A team called Efficient Spectrum—made up of two engineers employed at a large defense contractor but competing as individuals—won this tournament and its US $50 000 grand prize. Team GTRI, a group of research faculty members from the Georgia Tech Research Institute, came in second place and won $25 000.
In the other tournament, three teams per match were judged on how well their algorithms shared spectrum. This type of technology is more germane to commercial applications in unlicensed bands, where there is no prior coordination or even definitive rules. In particular, this is how companies hope to use the unlicensed TV white spaces freed up by the Federal Communications Commission. In these matches, the team that transmitted the most packets won, but it also got the number of packets transmitted by the second-highest scorer added to its total, which helped it in later rounds. This was intended to encourage cooperation, because a win depended not only on how many packets a team successfully sent and received but also on how successful the other teams were. A team made up of an assistant professor and an undergraduate from Tennessee Technological University won this competition, receiving $50 000, with Efficient Spectrum placing second for a $25 000 prize.
The running of the algorithms and broadcasting of the signals was performed remotely, at the Open-Access Research Testbed for Next-Generation Wireless Networks, known as Orbit, a radio research lab at Rutgers University, in Piscataway, N.J. That ensured that the algorithms were run independently, using the same hardware, so the software could be judged clearly on its own merits.
For each match, the Orbit staff programmed the system with the teams’ algorithms, and the race was on. A display of each team’s signals was live-streamed to the audience at DARPA, which lent the competition a spectator-sport atmosphere. At the top of the display were spectrograms showing the frequencies over which each team’s source and destination nodes were transmitting. In real time, the teams and audience watched as one team or another pulled ahead or, in a couple of instances, didn’t even make it out of the gate.
Yiftach Eisenberg, program manager of DARPA’s Information Innovation Office and organizer of the challenge, provided a play-by-play for each match, commenting on how each team was doing, noting when a team was pulling ahead, and explaining what some of the waveforms indicated. In the adversarial tournament, some teams actively tried to interfere with the others’ signals, but that approach wasn’t as prevalent as it was in the preliminary competition, held last September, when the propensity for interference was so high that sometimes neither team was able to transmit or receive anything. As a consequence, DARPA made some adjustments to reduce the interference levels, says Eisenberg.
Eisenberg notes that many of the teams had dramatically improved their designs since September. “I’m amazed at how much innovation took place between the preliminary tournament and this one,” he says. Specifically, in September teams used designs without feedback loops, spectrum sensing, or adaptation. “Today, what we saw was that many of the teams made this huge leap to radios that can sense and adapt their transmissions in real time.”
The final competition proved “that spectrum sharing among peers is feasible. We can take different systems in a complex environment, and they can share the spectrum without human intervention and spectrum preplanning,” says Eisenberg.
Among the most valuable lessons of the competition were the things that didn’t work. “We saw the unintended consequences and unexpected behaviors when you put these adaptive systems together,” he says. In one match, for example, one team started its transmission by displaying its logo in the spectrogram, which somehow prevented its competitor from registering its program and starting transmission. That was a surprise to both teams and to Eisenberg. “These are the kinds of things none of us could have ever predicted or tested for,” he says. “This is what happens in real life, when dynamic complex systems are thrown into dynamic complex environments.”
For more information visit https://spectrum.ieee.org.