"Artificial Intelligence" To Be Implemented In HFT

The increasingly fast electronic trading systems have become too fast for humans to handle. We are now seeing a wave of  investment firms turning to the science of artificial intelligence to make investment decisions. Unlike most Wall Street actors, the trading robots are capable of learning from their mistakes.

“No human could do this. Your head would blow off.”

Michael Kearns

With artificial intelligence, programmers don’t just set up computers to make decisions in response to certain inputs. They attempt to enable the systems to learn from decisions, and adapt. Investors using the approach are implementing “machine learning”  – a branch of artificial intelligence in which a computers analyzes huge chunks of data to make predictions about the future.

The following post is based on an article by Scott Patterson, journalist with The Wall Street Journal, one of the few mainstream reporters who really understand the HFT business.

Scott Patterson

The original article was published in July this year, but have until recently only been available to WSJ’s subscribers.

According to Patterson, there’s a new wave of firms using machine learning to trade.

With artificial intelligence, programmers don’t just set up computers to make decisions in response to certain inputs. They attempt to enable the systems to learn from decisions, and adapt.

Most investors trying the approach are using “machine learning,” a branch of artificial intelligence in which a computer program analyzes huge chunks of data and makes predictions about the future.

It is used by tech companies such as Google to match Web searches with results and NetFlix to predict which movies users are likely to rent.

Young Geeks In Action

Rebellion Research

One of the new upstart in the AI race on Wall Street is Rebellion Research, a tiny New York hedge fund with about $7 million in capital that has been using a machine-learning program it developed to invest in stocks.

Run by a small team of twenty-something math and computer whizzes, Rebellion has a solid track record, topping the Standard & Poor’s 500 stock index by an average of 10% a year, after fees, since its 2007 launch through June, according to people familiar with the fund.

Like many hedge funds, its goal is to beat the broader market year after year.

“It’s pretty clear that human beings aren’t improving,” says Spencer Greenberg, 27 years old and the brains behind Rebellion’s AI system. Adding:  “But computers and algorithms are only getting faster and more robust.”

Some sophisticated hedge funds such as New York based Renaissance Technologies LLC are said to already have deployed AI to their investing programs.

For years, these firms were the exceptions. But not anymore.

The Rise of The Machines

Rebellion is part of a new wave of firms using machine learning to trade. Cerebellum Capital, a San Francisco hedge fund with $10 million in assets, started using machine learning to invest in 2009, according to Patterson and The Wall Street Journal.

A number of high-frequency trading firms, such as RGM Advisors LLC in Austin, Texas, and Getco LLC in Chicago, are using machine learning to help their computer systems trade in and out of stocks efficiently, says people familiar with the firms.

The programs are effective, advocates say, because they can crunch huge amounts of data in short periods, “learn” what works, and adjust their strategies on the fly.

In contrast, the typical quantitative approach may employ a single strategy or even a combination of strategies at once, but may not move between them or modify them based on what the program determines works best.

Will Blow Your Head Off

“No human could do this,” says computer scientist, Professor Michael Kearns, at the University of Pennsylvania who has used AI to invest at firms such as Lehman Brothers Holdings Inc. “Your head would blow off.”

Rebellion has struggled to raise money, in part because investors since the credit crisis are dubious of opaque math-based strategies.

The firm has attracted at least one long-time “quant” skeptic: famed value investor Jean-Marie Eveillard, who recently invested several hundred thousand dollars of his own money into Rebellion.

“My cup of tea is not quantitative investing,” he says. “But I think they are serious investors, and I’m impressed by the fact that they don’t have a high turnover…and don’t use leverage.”

TradingSolutions is one of the systems using AI. Click the pic if you want to try it, or some of the others platforms available.

Rebel With Tradition

Rebellion’s Spencer Greenberg is no stranger to the investing world.

His father, Glenn Greenberg, is an iconoclastic value investor and manager of Brave Warrior Advisors, who recently split from his partners at Chieftain Capital Management Inc.

Spencer Greenberg

His grandfather, legendary baseball slugger “Hammerin’ Hank” Greenberg, played for the Detroit Tigers in the 1930s and ’40s.

But past success doesn’t mean Rebellion will continue to beat the market. As with many quantitative strategies, its system could stop working if market fundamentals change in ways that trip up its computer program, known as “Star.”

What makes Star intelligent, says Mr. Greenberg, is its ability to adjust its strategy based on shifting dynamics in the market and broader economy.

The program isn’t wed to any single investing approach. Under certain conditions, the fund will buy cheap stocks, in others it will favor stocks with swiftly rising prices—or both at the same time.

Long Term – No Leverage

Unlike the high-frequency funds that use artificial intelligence to aid rapid trading, Rebellion tends to hold stocks for long periods—on average four months but in some instances more than two years.

It also doesn’t short stocks or use leverage, or borrowed money, which can amplify returns but also boost risks.

The program monitors about 30 factors that can affect a stock’s performance, such as price-to-earnings ratios or interest rates.

The program regularly crunches more than a decade of historical market data and the latest market action to size up whether to buy or sell a stock.

When certain strategies stop working, the program automatically incorporates that information, “learns,” and adjusts the portfolio.

For instance, it may detect data indicating stocks with low price-to-earning ratios are likely to rise and load up on those stocks. Then, if the program later finds that the strategy is likely to lose steam, based on shifts in the factors it tracks, it will dump those stocks and buy stocks it deems more favorable.

A  Star Is Born

Every morning, Star recommends a list of stocks to buy or sell—often it offers no changes at all. A human trader implements the moves.

The firm says it never overrules the computer program, which is largely the same system they started with in 2007, with a few nips and tucks.

Rebellion typically holds about 60 to 70 stocks at any time.

Mr. Greenberg started designing Star in mid-2005, soon after he graduated from Columbia University with an engineering degree. He was joined by Alexander Fleiss, a high-school friend with a background in finance and math, as well as Jonathan Sturges, who has a master’s degree in music composition, and Jeremy Newton, a mathematician who helped design the AI program.

In January 2007, with $2 million in capital, the program started picking stocks. That spring, it started moving into defensive positions such as utilities. Rebellion gained 17% in 2007, compared with the 6.4% gain by the Dow Jones Industrial Average, according to people familiar with the fund.

It stayed defensive throughout most of 2008, holding gold, oil and utility stocks. Still, it lost money like most investors, sliding 26% but topping the 34% decline by the Dow industrials.

In early 2009, Star started to buy beaten-down stocks such as banks and insurers, which would benefit from a recovery.

“He just loaded up on value stocks,” says Mr. Fleiss, referring to the AI program. The fund gained 41% in 2009, more than doubling the Dow’s 19% gain.

The firm’s current portfolio is largely defensive. One of its biggest positions is in gold stocks, according to people familiar with the fund.

The defensive move at first worried Mr. Fleiss, who had grown bullish. But it has proven a smart move so far. “I’ve learned not to question the AI,” he says.

“Wall Street is notorious for not learning from its mistakes. Maybe machines can do better,” Scott Patterson writes.

However, personally, I’d like to point out that even the highest level of artificial intelligence is no match for natural human stupidity…

Related by The Swapper:

The Ultimate Trading Weapon

Survey: Market Surprised By Negative Derivative Perception

Testimony Of A High Frequency Trader

The Rise Of The New Market Makers

Flight to Mystery

May 6. 2010: “The Black Thursday”

Wall Street Collapse: Did Somebody See It Coming?



Filed under Technology

3 responses to “"Artificial Intelligence" To Be Implemented In HFT

  1. Pingback: Internet marketing needs hard work and intelligence. Not everyone gets an easy road | Cash Backee

  2. Pingback: “Artificial Intelligence” To Be Implemented In HFT « Econotwist's Blog

  3. Artist Born for the Green Movement.
    It all started on a landfill in Tampa.
    Could you be the one to Help tell the story of Hongkongwillie? After you Google the life and times of Hongkongwillie,and you feel this life and story has social impact. Help spread and make it go viral. The story is important,not the person. Thanks joe.