Tuesday, April 26, 2016

Trump Haiku


Craig Kaplan, my brilliant and whimsical colleague, has invented a twitterbot, trump575, that tweets haikus constructed from the opus of Donald Trump. You can follow it here.

Sunday, April 24, 2016

You are Not Allowed to Laugh at the Lies and Idiocies of the Right!


Somebody sent me a link to this piece by Emmett Rensin at Vox.

The author's thesis is that liberals have stopped thinking and spend all their time being smug instead -- but this is certainly not true of conservatives. Liberals, according to Rensin, "hate their former allies". Conservatives, by contrast, are open-minded and persuadable. And, Rensin says, The Daily Show is a perfect example of this liberal smugness.

Well, Rensin goes wrong right there. "Smug" is not even close to the right word to describe Jon Stewart. Bill Maher is smug. Jon Stewart is, at times, almost painfully earnest. Does he make fun of people? Absolutely. But modern conservatism has so many targets that the jokes write themselves: Ben Carson and his pyramids that stored grain. Donald Trump and his claim that he saw "thousands and thousands" of American Muslims celebrating the 9/11 attacks. Ted Cruz and his "Trus-Ted" slogan, when his record of public dishonesty is hard to deny. Rensin apparently thinks we are not allowed to poke fun at all this idiocy and dishonesty.

Here are some examples of liberal smug ignorance, according to Rensin: "the Founding Fathers were all secular deists". Well, that's clearly not so, but some were, at least during part of their life, like Thomas Paine and Ethan Allen. But how is this mistake worse than the conservative claim that "94 percent of the [the era of the Founders'] documents were based on the Bible" (debunked here)?

Another one: "that you're actually, like, 30 times more likely to shoot yourself than an intruder". Perhaps the number "30" is wrong, but that doesn't mean that there isn't a significant health risk in owning a gun. And how is this mistake worse than the conservative insistence on "more guns mean less crime"? Pro-gun "researchers" such as Kleck and Lott are treated by conservatives as unimpeachable, when in fact their errors are extensively documented.

Rensin's thesis is essentially a denigration of the importance of knowledge and facts. Who cares, Rensin says implicitly, if watching Fox News makes you less well informed? Pointing that out is just liberal smugness. Knowledge and facts are just unimportant compared to empathy and open-mindedness, which liberals today lack (while, presumably, conservatives have it in spades). Pay no attention the fact that when President Obama cited empathy as a desirable characteristic in a Supreme Court justice, conservatives jumped all over him.

Open-mindedness is a virtue -- I'll agree with that. But open-mindedness without skepticism and facts and knowledge just becomes credulity, a willingess to believe anything if it confirms your world view.

Here are just a few of the things that conservatives "know" that just ain't so: that Al Gore claimed to have invented the Internet (debunked here); that Bill Clinton delayed air traffic while he was having a haircut (debunked here); that Hillary Clinton was fired from the Watergate investigation for incompetence (debunked here). Visit any conservative website, mention Al or Bill or Hillary, and you'll only have to wait a few minutes before one of these lies is dragged out yet again. I have grad-school-educated conservative friends that proudly repeat these stories, ferchrissake.

Rensin claims that all this liberal smugness has "corrupt[ed]" them, but he gives no examples of corruption. He claims the case against conservatives is "tenuous", but just dismisses evidence like that given above and his own article.

Rensin thinks it is somehow "smug" for atheists to point out the religious hypocrisy of Kim Davis. It is here that his argument (and I use the term generously) becomes the most unhinged. Is it really necessary to be a Christian to criticize Christians? Do you have to believe in the divinity of Jesus or be a professional theologian to point out that Kim Davis cannot find support for her actions in Christian theology? When Mike Huckabee opportunistically elbowed out Ted Cruz to be at Kim Davis's rally, Rensin finds Huckabee genuine and admirable, instead of the pandering opportunity it clearly was.

Rensin is rhetorically dishonest. At one point he tries to refute a claim about the Ku Klux Klan by citing statistics about Stormfront.org. But these are entirely different groups.

Rensin is upset that the Daily Show is "broadcast on national television". Has he never listened to Fox News? Or conservative radio hosts with huge audiences, like Mark Levin and Michael Savage? The vitriol and the outright lies that happen every single day in these venues make Jon Stewart look like gentle fun.

Rensin claims that only Democrats have "made a point of openly disdaining" the dispossessed. One can only make that claim by wilfully ignoring the time Donald Trump made fun of a disabled reporter, or the time a Republican congressional candidate called poor people slothful and lazy, or Mitt Romney's comment that he could never convince 47% of the American people that "they should take personal responsibility and care for their lives".

Rensin thinks liberal smugness is going to ensure a Trump victory: "Faced with the prospect of an election between Donald Trump and Hillary Clinton, the smug will reach a fever pitch: six straight months of a sure thing, an opportunity to mock and scoff and ask, How could anybody vote for this guy? until a morning in November when they ask, What the fuck happened?". Yet who is a better match for the word smug? Hillary Clinton? Bernie Sanders? Look, when even Bill Maher calls you smug, you know you've got smug issues.

Finally, I observe that there doesn't seem to be any way to leave comments on Rensin's piece. That seems pretty smug to me.

Thursday, April 21, 2016

The Small Mind of the Conservative


Here is a splendid example of a certain kind of conservative mind: the kind that can't imagine how things could be any different, or why anyone would want them to be any different, from the way they are today. This kind of person always says, whenever anything novel is brought up, "But we've always done it this way!" Next, they go on to invent all sorts of silly reasons to avoid making any change.

Small-minded is what we used to call this trait, and it's particularly on display here. Mike Strobel, who despite once being Editor-in-Chief of the Toronto Sun doesn't seem to know the difference between "stationary" and "stationery", can't think of a single decent reason to turf the monarchy in Canada.

Instead, he believes keeping them around is a good idea because "the Trudeaus might declare themselves Canada’s royal family and we’d wake up one morning as subjects of King Justin". Perhaps the Queen will save Strobel someday by pushing him out of the way of an errant taxi. Those two preposterous scenarios are about equally likely.

Allan Fotheringham, a commentator that actually has connected brain cells, once said, "Grown-up nations do not need, as head of state, a woman -- however nice -- who lives across a large ocean in a castle in a foreign country." Someday Canada will grow up. Strobel, I'm not so sure about.

Wednesday, April 20, 2016

Under the Influence - An Amazingly Good Radio Show about Advertising


There are only a few radio shows I listen to regularly, but one of them is "Under the Influence" on CBC, an amazingly good show about advertising, hosted by Terry O'Reilly. I recommend it. O'Reilly may have a kind of whiny voice, but he seems to possess detailed knowledge about all facets of advertising, and he paints great pictures with his descriptions.

The latest show is about business-to-business advertising, and features a couple of famous commercials I had never seen before: the Jean-Claude van Damme ad for Volvo, and the "herding cats" ad for EDS.

Do you know any niche radio shows that are exceptionally good?

Tuesday, April 12, 2016

How to Be a Good Little Right-Wing Pundit


Right-wing pundits see bullies everywhere they look. But always on the Left, never on the Right.

Right-wing pundits see lynch mobs everywhere they look. But always on the Left, never on the Right.

A great example is Yale computer scientist David Gelernter. As I've pointed out before, when philosopher Thomas Nagel published a book about materialism, he got a lot of public criticism for his silly and uninformed views. But, according to Gelernter, all this criticism was downright unfair: he called Nagel's critics "punks, bullies, and hangers-on of the philosophical underworld" and a "lynch mob" and a "mass attack of killer hyenas".

But nobody picketed Nagel, or demanded he be fired from his academic job, or threatened to boycott journals where he published. They just criticized him.

Has Gelernter ever stood up for leftist professors who have been threatened with bodily harm or loss of their jobs for their opinions? Not that I've seen.

The latest right-wing pundit to get into hysterics is Brendan O'Neill. He calls transgenderism "intolerant". Novelist Ian McEwan was "subjected to a Twitch hunt", which is a "bloodsport". Critics of McEwan "went berserk" and engaged in "virtual tomato-throwing". It was "reminiscent" of "the Inquisition". The criticism was "attempted silencing". It was "straight out of Nineteen Eight-Four".

Yup, bullies and lynch mobs everywhere. Except that there aren't any lynch mobs. Nobody attacked McEwan physically. Nobody got in his face, or blocked his path, or threatened him. All critics did was take issue with what he said.

If you want to be a good little right-wing pundit, you have to learn this game. All criticism from the Left is "bullying". All criticism from the Right is "free speech". All criticism from the Left is just like the Inquisition. All criticism from the Right is brave disagreement with the status quo. All criticism from the Left is Orwellian. All criticism from the Right is the true spirit of democracy.

Good little right-wing pundit. Have a puppy treat.

Monday, April 11, 2016

NPR's Word Puzzle


NPR's Sunday puzzle last week was the following: find a five-letter word in which the position, in the alphabet, of the first letter is equal to the sum of the positions of the last four letters.

This week they gave the following answers: maced, table, whack, and zebra.

More generally, one could ask the same question for words of other lengths. Here are a few I found:

cab
hag
jade
leaf
leg
mage
mica
mid
need
pig
rale
real
ride
same
sand
seam
toad
toe
vial
vim
weeded
wend
who
wick
win
yet
yip
zeta
zinc

So "weeded" seems to be the longest word in English with this property. Can you find a longer one?

They also talked about words like "easy" in which the position of the last letter is equal to the sum of the positions of the preceding letters. I found the following other examples:

abbot
ally
away
babe
bail
bendy
bidet
bleat
boar
cachet
debit
dim
draw
eager
fag
feces
flew
gnu
habit
hair
hem
hoax
how
idly
jaggy
joy
kit
lam
man
neat
pact
paddy
sex
tabby
tau
wax

So the longest seems to be "cachet". Can you find a longer one?

Sunday, April 10, 2016

They Offer Nothing But Lies, 6


Once again, the creationists are telling fibs about information theory. Are they dishonest, or just stupid? In the case of Denyse O'Leary, I'm inclined to suspect the latter:

The belief that randomness produces information (central to Darwinism) is obviously false. It’s never been demonstrated because it can’t be. It is assumed.

No, it's not "assumed". It's proved. It's one of the most basic results in Kolmogorov information theory, demonstrated every year in the classes I teach. With high probability, a randomly-generated list of symbols will contain a lot of information. To understand this you can use one of Dembski's own metaphors: the combination lock. Which will be harder for someone to deduce, a combination that is your birthday in the form mmdd, or the first four digits of pi, or a randomly-generated 4-digit code?

This does not seem to penetrate the skull of the rather dense Ms. O'Leary, who then tries to weasel out of her claim by saying

by "information," one means here complex, specified information, produced in vast interlocking patterns on a regular basis.

Oh, so she's not talking about "information" in the way it is used by mathematicians and computer scientists. She's talking about creationist information, that vague, incoherent, and self-contradictory mess invented by Dembski and used by basically no one except creationists.

That mess was debunked years ago.

Here's an example: take any English text T, like the first 10 lines of a Shakespearean sonnet. Now apply any decent encryption function f to it that is not known to an adversary, getting U. To the adversary, U will look like random noise and hence be "unspecified", so it will not constitute creationist information. Now I come along and apply f-1 to U, getting T back again. Voilà! I have now magically created information deterministically, something Dembski claims is impossible.

No matter how many times you explain this, creationists offer nothing but lies in response.

Saturday, April 09, 2016

Margaret Russell on Mississippi's Anti-Gay Law


Here's my old pal Margaret "Peggy" Russell, professor of law at Santa Clara, speaking on KQED about the new anti-gay law passed in Mississippi.

Mississippi is one of three US states I've never visited. I probably won't visit while this law is in effect.

Thursday, April 07, 2016

Another Day, Another Right-Wing Quote Lie


It seems that pretty much every day of the week, one can find right-wing spokesmen using fake quotes to justify their beliefs.

Today's lying wingnut is Sarah Palin, who gave a sing-song speech-like thingie in Wisconsin supporting Donald Trump to barely any applause at all. Near the end (at the 20:30 mark of the video), she says, "Well, General George Patton, he said it best, he -- leading the greatest generation -- he said 'Politicians are the lowest form of life on earth', he said it, I didn't, OK? he said it. And he said, 'Liberal Democrats are the lowest form of politicians.' "

Well, no, Patton didn't. This was debunked months ago.

Sarah Palin, like most of her wingnut friends, is completely uninterested in the truth. All she cares about is having a cudgel to beat Democrats with.

Wednesday, April 06, 2016

These Lawyers are All ASSoLs


This is pretty funny: two donors paid off George Mason University to the tune of $30 million to change the name of their mediocre law school (rated #40 in the US by one measure) to the "Antonin Scalia School of Law".

I guess nobody noticed at the time that the acronym "ASSoL" was really, really appropriate. At least not for a while. But now they've quietly changed their public presence to the "The Antonin Scalia Law School at George Mason University".

That won't prevent everyone else from calling them ASSoLs, though.

Tuesday, April 05, 2016

Cold-FX Lawsuit May Be a Remedy for False Health Claims


Cold-FX, a drugstore remedy hawked by Canadian fashion icon Don Cherry, is the subject of a lawsuit alleging the makers "ignored their own research and misled consumers about the short-term effectiveness of the popular cold and flu remedy". Cold-FX is basically just some sort of ginseng extract, although they give it the fancy name "CVT-E002". The suit was brought by Don Harrison of Vancouver Island.

Questions about the efficacy of Cold-FX have been raised for years.

Whether or not the claims of Cold-FX are false -- nothing has been proven in court yet -- there is no question that there is a lot of fraud in the over-the-counter pharmacy market, including worthless homeopathic remedies marketed as being effective against a wide variety of illnesses.

Hopefully this lawsuit, whether it succeeds or not, will make pharmaceutical companies much more diligent about ensuring the veracity of their claims.

Friday, March 25, 2016

Et in Arcadia Ego


Monday, March 14, 2016

The Future of Recursivity


Hello, readers! I'm pleased to announce that I've joined freethoughtblogs.com, home of P. Z. Myers and other interesting bloggers.

This doesn't mean that this blog will die. I intend to cross-post things here and there. Comment wherever you like.

More info later, as I learn how to use the new system.

Thursday, March 03, 2016

James Tour's First Talk: Nanotechnology and God


The dilemma of the scientist who is also a devout Christian* is clear: on the one hand, in his/her professional life the scientist must explore the natural world and rigorously apply skepticism to his/her conclusions. The scientist is always asking, "Could there be some other explanation I haven't thought of?". On the other hand, the devout Christian is required to accept an incoherent and nonsensical theology, and to renounce other reasonable explanations for the events that supposedly occurred in the New Testament. Skepticism is replaced by faith.

This is one reason, I suspect, that Christians are more common in the physical sciences and less common in fields like anthropology, psychology, and sociology. A really serious anthropologist or sociologist or psychologist who is a believer would be, I suspect, consumed by trying to understand the personality, motives, and characteristics of the Christian god, and that can only be done with some rigor through a scientific study, which the Christian is explicitly forbidden to do by Matthew 4:7, Deuteronomy 6:16, and Luke 4:12. In contrast, the chemist, geologist, or physicist is able to compartmentalize his/her beliefs more successfully. Believing in Jesus is not going to strongly impact your experiments if you are studying the properties of organic compounds or the interactions and decays of baryons.

Compartmentalization is the key word here, and it was very much in evidence in last night's Pascal lecture. To say it was a lecture is somewhat overstating the case. It started with a commercial (for James Tour's lab and its admittedly excellent work in nanotechnology) and it finished with pure Christian evangelism. Given that the title was "Nanotechnology and God", I was expecting a somewhat more polished segue between the two topics (although it was too much to hope that he might have remarked that both topics concern the vanishingly small). There was none. Prof. Tour went in one sentence from a summary of his work on nanotechnology to a story of how he became a Messianic Jew. Along the way he admonished the audience in various ways: to abjure pornography, to pray for personal success, to read the bible every day.

Here are a few of the things that Prof. Tour seems to believe, as I understand it. First, that the "fact of the Resurrection is overwhelming". (I don't think he uses the term "fact" the way I do.) Second, that he obtained his wife because he prayed for one and his god granted his wish. Third, that he was offered money to buy more software (through some supernatural intervention?) because of his virtuous refusal to break the license of software he used on other machines. Fourth, that he prays before every course lecture and scientific talk that his presentation will be wonderful. Fifth, that he prayed for the success of a disliked colleague and this resulted in the success of the colleague and his transfer to another university. Honestly, it was really hard to not laugh at all that.

I find it fascinating that such a scientist -- evidently extremely clever -- can successfully convince himself that there is a supernatural being, the creator of the universe, who is so obsessively concerned in that scientist's success and life that he (the god) arranges things so that departmental money to buy software arises (because of the scientist's virtue) and so that rival colleagues get offers to leave.

I did get a chance to ask a question. After hearing this litany of successes that Prof. Tour had achieved through prayer, I asked him what percentage of things he prays for don't come true. He was unable to provide a figure. This is compartmentalization again. A scientist would, I would think, want to know this important fact. Do certain kinds of prayers work better than others? Does the time of day affect success? Is success actually greater than chance, or does Prof. Tour simply forget about the prayers that don't come true? Does it help if the prayer is said in certain languages? Are prayers for oneself granted more often than prayers for others? What happens when two equally virtuous people pray for opposite outcomes?

Another thing that I was able to establish was that Prof. Tour, despite being a signatory to the Discovery Institute's notorious "Scientific Dissent from Darwinism", has never read a college-level textbook about evolution. In my opinion, this is irresponsible (but not surprising).

In short, although Prof. Tour is a good speaker who clearly has done excellent work, his religious beliefs seem (to me) to be childish and unwarranted. His personal version of prosperity theology is laughable. The event was largely evangelical and not intellectual in nature, and is inappropriate to be sponsored and endorsed by a public university that accepts students of all faiths. It was, in short, another embarrassment.

* I phrase it this way to avoid the ambiguous term "Christian scientist".

Wednesday, March 02, 2016

The Pascal Lecture, James Tour, and Shallit's Law


Well, once again it's time for that annual embarrassment at the University of Waterloo, the Pascal lecture series.

Our university actually sponsors these lectures, which are designed to "[challenge] the university to a search for truth through personal faith and intellectual inquiry which focus on Jesus Christ." I think it's completely inappropriate for a secular university to evangelize for a particular religion in this manner.

Previous lectures that I've attended and written about include Mary Poplin (also see here and here); the late Charles Rice (also see here and here); and John Lennox (also see here and here and here).

This year the speaker is James Tour, a chemist and signer of the infamous Discovery Institute dissent from Darwinism letter. You can see Tour's own rambling account of his dissatisfaction with evolution here. I hope he's a better speaker than he's a writer.

For more about Tour, see Larry Moran's take here.

I'm going to try to go, but I may be too jet-lagged to do so. In any event, I want to recall a law I have modestly named after myself: Shallit's law. Here it is:

"Whenever a distinguished scientist, physician, or engineer claims that he or she `doesn't understand' evolution, or `encourages skepticism' about evolution or that evolution `skeptics' are poorly treated, some fatuous utterance about Jeebus will soon follow."

You can evaluate the accuracy of Shallit's law by attending Tour's lectures, I suppose.

P. S. The Pascal lecture committee, as well as other dubious sites, like to cite Tour as "one of the 50 most influential scientists in the world" as stated by thebestschools.org. But thebestschools.org is a project of none other than James Barham, the ID-friendly but extremely confused philosopher who testified for the creationists in Kansas. In other words, it is not an unbiased source. In fact, I don't see much evidence that it's anything more than just James Barham sitting in a basement somewhere.

Wednesday, February 17, 2016

What Scalia Was Truly Like


If you want to get a feel for what the late Supreme Court justice Antonin Scalia was like, you can do no better than to read this long interview from three years ago.

Some highlights: despite being so "brilliant", Scalia was unsure about the pronunciation of the word "ukase" and wasn't familiar with the term "tell" as applied to poker. I am neither a lawyer nor a poker player, but I knew both of these. And I'm not particularly bright.

Scalia also knew nothing about linguistics, if he thought "Words have meaning. And their meaning doesn’t change." That's an extremely naive view of language and meaning. In reality, the meaning of words is fuzzy and smooshed out. And meaning changes all the time. Compare our current understanding of "nubile" with the dictionary definition from a dictionary 50 years ago.

Scalia read the Wall Street Journal and the Moonie-controlled Washington Times, but stopped reading the Washington Post because it was "slanted and often nasty". He didn't read the New York Times at all. Talk about being unaware of your own biases!

Scalia believed that the "Devil" is a real person because it is Catholic dogma (and by implication, because one cannot be a Catholic without accepting all of Catholic dogma). That's exactly the kind of black-and-white extremist viewpoint it takes to be an originalist. He thought this being was occupied in getting people not to believe in the Christian god. And he liked The Screwtape Letters, easily the stupidest of C. S. Lewis's output (and that's saying something). Scalia justified his belief by saying "Many more intelligent people than you or me have believed in the Devil." Yeah, well, many more intelligent people than I believe in Scientology, Bigfoot, and alien abductions, but that isn't a good argument for them. He also said that the Devil's becoming cleverer was "the explanation for why there’s not demonic possession all over the place. That always puzzled me. What happened to the Devil, you know? He used to be all over the place." The other explanation -- that there is no Devil and demonic possession never happened (it was health conditions misinterpreted by an ignorant and superstitious populace) -- was too obviously correct for him to consider.

Scalia thought that the only two possible choices after his death were "I'll either be sublimely happy or terribly unhappy." The obvious correct choice -- namely that he would simply cease to be -- did not even enter his mind as a possibility.

Scalia thought he was "heroic" by not recusing himself in a case where he clearly should have recused himself.

Reading this interview I could only think: What an asshole! Good riddance.

Monday, February 15, 2016

My Scalia Experience


Now that Supreme Court justice Antonin Scalia has died, one can find tributes to him everywhere, even from some liberals. He is being lauded for his intelligence and for being a nice guy in person.

Well, my Scalia experience is different. First, he may have been extremely intelligent, but even intelligent people can have blind spots. For Scalia, one obvious blind spot was the theory of evolution. Not only did he not understand the status of the theory among scientists, as Stephen Gould famously pointed out, but he also recently used the figure "5000 years" as an estimate for the age of humanity, when the actual figure is more like 100,000 to 200,000 years.

And as for being a nice guy, I can only tell about my own experience. Sometime in the late-1980's (I think it was 1987) he came to give a speech at the University of Chicago when I was teaching there. At the end of the talk there was time for questions. I asked a question -- and I don't really remember what it was about -- and Scalia got all huffy. He said something like, "I don't think that's appropriate for me to answer. In fact, it was completely inappropriate for you to ask."

Well, it wasn't. It was something definitely appropriate and about constitutional law, even if I don't quite remember what I asked. What I remember was the contempt he expressed in his words and body language that anyone would dare ask.

So maybe it's true, as some have said, that he was a wonderful guy with a great sense of humor and enormous intelligence. All I can say as an outsider is, not in my experience.

Yet Another Dubious Journal


From a recent e-mail message I received:

Dear Dr. Jeffrey Shallit,

Greetings from Graphy Publications

We kindly invite you to join the editorial board for International Journal of Computer & Software Engineering

The journal aims to provide the most complete and reliable source of information on current developments in the field of computer & software engineering. The emphasis will be on publishing quality articles rapidly and making them freely available to researchers worldwide. The journal will be essential reading for scientists and researchers who wish to keep abreast of the latest developments in the field.

International Journal of computer & software engineering is an international open access journal using online automated Editorial Managing System of Graphy Publications for quality review process. For more details please go through below link.

http://www.graphyonline.com/journal/journal_editorial_board.php?journalid=IJCSE

Hope you accept our invitation and you are requested to send us your recent passport size photo (to be displayed on the Journal’s website), C.V, short biography (150 words) and key words of your research interests for our records.

We are keenly looking forward to receiving your positive response

Yours sincerely,

J. Hemant
Managing Editor
International Journal of Computer & Software Engineering
Graphy Publications

Any journal of "computer & software engineering" that invites me to be on the editorial board, when I don't work in either computer engineering or software engineering, is clearly not to be taken seriously. Other bad signs: random capitalization of invitation letter, failure to end sentences with the proper punctuation, and an editorial board filled with people I've never heard of. Not surprisingly, the publisher, "Graphy Publications", is on Beall's List of Potential, possible, or probable predatory scholarly open-access publishers.

Thursday, February 11, 2016

Reproducibility in Computer Science


There has been a lot of discussion lately about reproducibility in the sciences, especially the social sciences. The result that garnered the most attention was the Nosek study, where the authors tried to reproduce the results of 98 studies published in psychology journals. They found that they were able to reproduce only about 40% of the published results.

Now it's computer science's turn to go under the spotlight. I think this is good, for a number of reasons:

  1. In computer science there is a lot of emphasis placed on annual conferences, as opposed to refereed journal articles. Yes, these conferences are usually refereed, but the reports are generally done rather quickly and there is little time for revision. This emphasis has the unfortunate consequence that computer science papers are often written quite hastily, a week or less before the deadline, in order to make it into the "important" conferences of your area.

  2. These conferences are typically quite selective and accept only 10% to 30% of all submissions. So there is pressure to hype your results and sometimes to claim a little more than you actually got done. (You can rationalize it by saying you'll get it done by the time the conference presentation rolls around.)

    (In contrast, the big conferences in mathematics are often "take-anything" affairs. At the American Mathematical Society meetings, pretty much anyone can present a paper; they sometimes have a special session for the papers that are whispered to be junk or crackpot stuff. Little prestige is associated with conferences in mathematics; the main thing is to publish in journals, which have a longer time frame suitable for good preparation and reflection.)

  3. A lot of research in computer science, especially the "systems" area, seems pretty junky to me. It always amazes me that in some cases you can get a Ph.D. just for writing some code, or, even worse, just modifying a previous graduate student's code.

  4. Computer science is one of the areas where reproducibility should (in theory) be the easiest. Usually, no complicated lab setups or multimillion dollar equipment is needed. You don't need to recruit test subjects or pass through ethics reviews. All you have to do is compile something and run it!

  5. A lot of computer science research is done using public funds, and as a prerequisite for obtaining those funds, researchers agree to share their code and data with others. That kind of sharing should be routine in all the sciences.
Now my old friend and colleague Christian Collberg (who has one of the coolest web pages I've ever seen) has taken up the cudgel of reproducibility in computer science. In a paper to appear in the March 2016 issue of Communications of the ACM, Collberg and co-authors Todd Proebsting and Alex M. Warren relate their experiences in (1) trying to obtain the code described in papers and then (2) trying to compile and run it. They did not attempt to reproduce the results in papers, just the very basics of compiling and running. They did this for 402 (!) papers from recent issues of major conferences and journals.

The results are pretty sad. Many authors had e-mail addresses that failed (probably because they moved on to other institutions or left academia). Many simply did not reply to the request for code (in some cases Collberg filed freedom of information requests to try to get it). Of those that did reply, their code failed for a number of different reasons, like important files missing. Ultimately, only about a half of all papers had code that passed the very basic tests of compiling and running.

This is going to be a blockbuster result when it comes out next month. For a preview, you can look at a technical report describing their results. And don't forget to look at the appendices, where Collberg describes his ultimately unsuccessful attempt to get code for a system that interested him.

Now it's true that there are many reasons (which Collberg et al. detail) why this state of affairs exist. Many software papers are written by teams, including graduate students that come and go. Sometimes they are not adequately archived, and disk crashes can result in losses. Sometimes the current system has been greatly modified from what's in the paper, and nobody saved the old one. Sometimes systems ran under older operating systems but not the new ones. Sometimes code is "fragile" and not suitable for distribution without a great deal of extra work which the authors don't want to do.

So in their recommendations Collberg et al. don't demand that every such paper provide working code when it is submitted. Instead, they suggest a much more modest goal: that at the time of submission to conferences and journals, authors mention what the state of their code is. More precisely, they advocate that "every article be required to specify the level of reproducibility a reader or reviewer should expect". This information can include a permanent e-mail contact (probably of the senior researcher), a website from which the code can be downloaded (if that is envisioned), the degree to which the code is proprietary, availability of benchmarks, and so forth.

Collberg tells me that as a result of his paper, he is now "the most hated man in computer science". That is not the way it should be. His suggestions are well-thought-out and reasonable. They should be adopted right away.

P. S. Ironically, some folks at Brown are now attempting to reproduce Collberg's study. There are many that take issue with specific evaluations in the paper. I hope this doesn't detract from Collberg's recommendations.

Tuesday, February 09, 2016

More Silly Philosopher Tricks


Here's a review of four books about science in the New York Times. You already know the review is going to be shallow and uninformed because it is written not by a scientist or even a science writer, but by James Ryerson. Ryerson is more interested in philosophy and law than science; he has an undergraduate degree from Amherst, and apparently no advanced scientific training.

In the review he discusses a new book by James W. Jones entitled Can Science Explain Religion? and says,

"If presented with this argument, Jones imagines, we would surely make several objections: that the origin of a belief entails nothing about its truth or falsity (if you learn that the earth is round from your drunk uncle, that doesn’t mean it’s not)..."

Now I can't tell if this is Jones or Ryerson speaking, but either way it illustrates the difference between the way philosophers think and the way everyone else thinks. For normal people who live in a physical world, where conclusions are nearly always based on partial information, the origin of a belief does and should impact your evaluation of its truth.

For example, I am being perfectly reasonable when I have a priori doubts about anything that Ted Cruz says, because of his established record for lying: only 20% of his statements were evaluated as "true" or "mostly true". Is it logically possible that Cruz could tell the truth? Sure. It's also logically possible that monkeys could fly out of James Ryerson's ass, but I wouldn't be required to believe it if he said they did.

For non-philosophers, when we evaluate statements, things like a reputation for veracity of the speaker are important, as are evidence, the Dunning-Kruger effect, the funding of the person making the statement, and so forth. Logic alone does not rule in an uncertain world; in the real world these things matter. So when a religion professor and Episcopal priest like Jones writes a book about science, I am not particularly optimistic he will have anything interesting to say. And I can be pretty confident I know his biases ahead of time. The same goes for staff editors of the New York Times without scientific training.