On my desktop sits a file, as a reminder. It’s the log of a Skype text chat dated 24 October 2007.
My desktop isn’t usually tidy, but this file always sits there in a corner. I haven’t read it in years, but its existence is, in itself, a reminder.
This article is third in a series of four. A couple weeks ago I wrote about whether or not we should try to develop new theories or to test existing ones by hopping on theoretical bandwagons.
Last week I wrote why theoretical bandwagons are good for, or at least well suited to, big labs and that small labs should avoid them. (You might want to read those over, if you haven’t yet, before reading the present post. Or not. Your call.)
This week, I’m explaining the kind of research that I choose to do in my own small lab.
This chat took place with a deep friend of mine as we both were undergoing career transitions, both of us starting out in new (and radically different) faculty positions. (It’s great when your friends are your role models, and when your role models are your friends, even if you only see one another in a long while. It’s not too often that you connect with others whose values and priorities are well calibrated to match your own, and it’s a pleasant confluence.)
Darwin was a tinkerer. (Richmond’s portrait of Darwin is from 1840)
I had just moved to a new position, back to my hometown. This change involved a massive shift in pretty much everything. I was wondering what kind of questions I should be pursuing, and how I should go about it. My friend was settling into a tenure-track position at a research institution and his lab was growing exponentially.
We were wondering what I was going to work on next. At this point, I wasn’t sure. I had a number of big questions that I wanted to tackle, each of which would involve a major direction for my lab. Up until this point, I had been doing a series of one-off projects (which essentially is what my dissertation was as well).
So, I threw out a bunch of ideas. I want to work on X, I want to work on Y, and Z looks interesting too. I said I didn’t want my work to get lost as ephemera, addressing theories-of-the moment.
Then, at the same moment, we independently stumbled on the term that describes the work that I enjoy most, and also has had the greatest impact.
Tinkering.
My best work has happened whenever I’ve found some little natural history curiosity that has piqued my interest, and then I designed an experiment (observational or manipulative) to tinker around with the system to figure out what’s going on. It was my doctoral advisor who first introduced me to “experimental natural history.” (Sorry about the paywall, damn JSTOR)
This leads to both the stuff that is most cool, interesting, and in the long term useful to other people. I think that good science happened because my approach was most likely to lead to discovery, even if discovery was not the goal.
Research is supposed to result in new knowledge.
What are the odds that you’re going to make a big discovery or formulate a grand theory as long as you’re working on the same ideas that other people are? How much are you pushing the frontiers of science when there are other people out there doing the same thing? If you’re working for a specific applied aim – an HIV vaccine, cancer prevention, et cetera, then I can understand that a massive push in one direction, like against a two-ton piece of stone, is what can make the stone move.
I’m not in the business of inventing vaccines for rapidly evolving viruses or building pyramids. I’m doing basic research. I’m just trying to understand how the world works. There is so little that is known, that I want to mine into directions that that are entirely mysterious. The world is still fundamentally mysterious.
I posit that there are two distinct philosophies that scientists have about the nature of our knowledge, with little middle ground. On one side are people who think that we have learned a lot in the fields that we have studied, and that research is filling in the gaps and discovering new fields that we have yet to understand. On the other side are people who think that we are still vastly ignorant about the world, and even the things that we have studied really heavily remain mysterious and what we think we know may in fact be wrong.
Is this a fair dichotomy? Does one of these describe you or do you fit in the middle somewhere?
I’m in the latter group (or at one end of the spectrum if it’s not a dichotomy). I suspect that a number of ecologists might fall into that group as well. For all the work that we’ve done, we’ve only scratched the surface, and that surface is probably deceiving. Some classic major concepts, such as “competitive exclusion,” are so simplistic that they don’t even begin to describe nature.
The one thing that students seem to learn in school about evolution is that Lamarck was wrong, and this lesson comes with a certain example involving a giraffe. It’s taken us a couple centuries to figure out that, to a certain extent, Lamarck was quite right about the inheritance of acquired characteristics after all. He just didn’t know the mechanism was epigenetic, just as Darwin wasn’t aware of the particulate inheritance mechanisms described by Mendel. Jerry Coyne addressed this a score of moons ago.
In short, some things we think we fundamentally understand, we really don’t. This is particularly the case for complex phenomena that are explained by theories requiring mechanisms that can’t be readily measured in nature. Natural selection is very straightforward and observable, and we have that one locked down. But many more intricate concepts in ecology? I wouldn’t buy stock in them.
If your research program is oriented towards testing theories, then you’re less likely to stumble on a new perspective.
When I design experiments, I “tinker” with natural systems by tweaking them in small ways to see what happens. I do this because I find something that’s curious to me, and I want to understand what’s happening in that system. I don’t pretend that what I find will answer a grand theory or unify different branches of our disciplines. I just want to get a little answer about a little thing that’s curious. My suspicion, that might approach something resembling belief, is that this kind of work will help us learn more about the world than most theoretically-driven research. I think that most of our major advances came from this kind of approach as well.
You’lll find some mildly unflattering things said about this approach, over at Dynamic Ecology. This is a healthful disagreement of opinion. (Heck, there might even be a claim that it wasn’t unflattering!) I recognize that what I’m writing goes against current dogma, that if your work isn’t driven by theory, then it’s not of much value. I can respectfully disagree, but then again, there’s no major concept or principle with my name on it, either, so I can’t push my point too firmly.
If you take a walk through a rainforest, a few hundred curiosities, with no known answers, should slap you in the face very quickly. This happens during a walk during the desert, as well, though with lower frequency as there’s less biomass.
When I walk through the rainforest, I see something new every time I step out. Among the things that visibly move under their own power, ants are clearly the dominant feature of rainforests. If I want to be able to ask a whole bunch of questions, and had to pick a taxon, ants are a good way to go. (A well known and true event is that Bert Hölldobler and Ed Wilson spent two weeks together at what is now my field site; it resulted in three very cool publications based on what they found.) One major unexplored frontier is the leaf litter of tropical rainforests. Nearly all of the the primary production of the forest ends up on this thin layer between the sky and the earth, as Jack Longino once said, and we know so little about it and its denizens. It’s a big linkage in food webs that is a huge black box with respect to most fields of ecology (aside from ecosystem ecology, though this is still not as well known as it could be in this respect).
Now you can see why I have trouble assembling an elevator talk.
I propose a taxonomy of research goals, with three domains:
- Discovery. Finding or creating something brand new – a species, a theory, a mechanism.
- Improving ideas. This is the theoretical bandwagon – amassing evidence to flesh out, support, refute or modify existing theories.
- Tinkering. There’s a little something that doesn’t make sense and you want to figure it out. Your goal is not to create a new theory or to test specific hypotheses.
Obviously the third category wouldn’t sit well with funding agencies. That’s not keeping me from adopting this approach as my primary orientation. From reading my papers, you wouldn’t necessarily be able to tell which primary goal led to a particular manuscript, though it’s almost always the result of tinkering. You can’t sell tinkering to well-read journals in the current environment. They want you start your story as if your experiment was always designed to test one very specific hypothesis, even if everybody knows that isn’t true.
When I’m wondering what project I want to do next, I do a few things. I weigh a bunch of factors – what’s fundable, what’s do-able, and what’s publishable.
Then I notice the file on my desktop, and I toss all of that crap aside.
I do that little thing that’s always been nagging: “Answer me!” Then, I go off and do that project. My only problem is that the list of nagging questions is far too long for me to answer in one lifetime.
You might be asking, “How’s that working out for ya?” I’ll get to that next week with some specific examples.
Hi Terry,
Thanks for another thought provoking post. I am really amazed at the quantity and quality of your posts. How do you the time?
I am not sure that there is such a strong dichotomy between tinkering and theoretical based research, or that one is always better than the other. You suggest tinkering is when you find some unanswered question, design an experiment where you change something and see how it changes the dynamics of the system. I would say in a way what you are doing is driven by theory in that you are not just picking any random thing to change, you are picking out something that you think will be very important in the system, probably in part based on theory and other empirical work in that system or similar systems. By not being “theory” or “hypothesis” based I assume you mean that you are not making any strong predications a priori about the shape of the response to the variable you are altering. But in a way it is still based on some sort of hypothesis: I think variable X will change they dynamics of system Y. I guess the difference is you are using previous work or theory to say only that X could be important, rather than how it is important. I don’t really have any problem with this, as from my experience I think we have the tendency to think in relatively simple terms, and tend to focus on one particular mechanism at the exclusion of others, think in terms of linear additive effects, and often don’t or can’t consider the potential interactions of feedbacks that may result in a more complex relationship. But my guess is even if you don’t predict a priori the relationship between X and Y (or even what Y is in the system of interest), your experiment was in large part influenced by theory in that if you did the experiment 10, 50, 100 years earlier or later, you probably have chose a different X or Y for you experiment.
In defense of theory, I think the main role of theory is synthesis. I don’t think the importance of synthesis can be overstated. In a world of only tinkerers, we continue to build up a massive amount of stories or mechanisms for thousands and thousands of systems and species. But imagine what an intro level ecology class would be like then, just a collection of stories. We need theory to bring together commonalities and themes from the vast array of stories. Theories in turn tell us what is important to look at, or which observations are to be expected and which are not.
Actually, now that I think about it, maybe the true dichotomy is whether you see synthesis or a collection of understanding specific systems as the ultimate goal in science.
I would agree with you that tinkering often leads to unexpected results that in turn leads to understanding and theory. But for that to happen it has to move beyond the tinkering stage, you need people to formalized and test the theory, otherwise it will remain a interesting story about a specific system.
Benjamin,
I think I’m only finding the time by giving up a vice or two – and so far it’s been fun enough that I’ve had to keep myself from doing too much.
I think theory really matters. People do need to do this work. And people always will be. Which is exactly why I’m advocating for tinkering. Leave the theory to others!
By saying I’m not testing theories or hypotheses, I’m not saying that I don’t have a set of ideas or expectations for whatever experiment I’m doing. I just haven’t framed this project deeply inside a theoretical framework. My research program isn’t driven by a set of specific questions. I’m not primarily community ecologist working to understand the process that direct assembly, for example. However, a lot of the things I find will be relevant to assembly, because I keep taking apart the community to look at the pieces. A great mechanic might say, “I’m not a mechanic who works on valve theory or exhaust systems. I just love old volvos.” But they sure know their values, exhaust systems, and every other part very well.
How I interpret my results is often tied to theory and hypotheses. However, that’s not what I pick to study. I pick something idiosyncratically if I come upon something that seems to be very mysterious. As I start to untangle it, then the results identify the theories that are relevant. It could be optimal foraging, it could be stoichiometry, it could be physiological, it could be game theory. But I just want to look into something that’s not yet known.
So, I think where I differ is not so much how we do the science, or report it, but how we pick what to work on.
You’re right about the discoveries then need to be formalized and theorized and evaluated. There are big labs for that!
Terry – great post. My research approach is closely aligned with yours. however, sometimes when i’ve tried to encourage graduate students to proceed with a project from more of this ‘tinkering’ approach, it’s been a struggle – especially when trying to have the student’s project approved at a committee meeting. There are strong views in opposition to the ‘tinkering’ approach and some view it is as too risky for a 1-2 year MSc project (for example). So.. to fully embrace some aspects of tinkering requires a significant culture shift.
Thanks – I agree, with MS students you’ve got to be careful in constructing a project. You want to be sure that, no matter what happens, you’ll get an answer, and that answer will be interesting. So, the lack of a result would be cool and publishable. In some cases, that can work. Ironically, usually my role on MS committees here is to ask for a better theoretical foundation for thesis questions. I’m okay with tinkering, of course, but oftentimes the tinker projects that students have for their theses aren’t going to yield interesting or useful results. It’s just toying around with something that’s already known, formally or informally. That’s not an acceptable thesis, in my view. On the bright side, that might be why I’m not on too many committees.
This seems relevant to various things you’ve been thinking about recently, so I just wanted to throw it out there:
http://nothinginbiology.org/2013/03/19/natural-history-in-the-omics-era/
Thanks – I actually caught this and thought it was great, and wanted to bring it up. I haven’t yet established a linky-post genre of posts, which would be good for when I’m short on time but have accumulated cool reads. I like the way Dynamic Ecology does the friday links, which is more thoughtful than the way most of these kinds of posts are constructed around the ‘sphere.
We originally started doing the linkfest post as a way to keep me from putting up too many posts too fast. Rather than doing a short post every day (which I was doing for a little while), do a couple of substantive posts a week plus the linkfest post on Fridays. So the linkfest posts have brief commentary because in my mind they’re really a bunch of short posts all rolled into one.
I feel like the commentary is necessary to give some added value. If you just want to share links, sans commentary, it seems like Twitter is a better way to do it.
The other thing I try to do in the linkfest posts is not to link to stuff lots of people are already likely to have seen, at least not unless I feel like I have something to say about it. That’s why I never do links to newly-published papers, or write posts summarizing newly-published papers, not even papers I personally find really cool. Again, it’s about trying to add value. Everybody already has their own ways of filtering the literature, and nobody but me has any particular reason to care about what papers I’m reading. So why would anyone care if I link to some new paper or summarize it? Plus, if people want commentaries on newly-published papers, well, there are other ecology blogs that do that (especially journal-associated blogs), plus Faculty of 1000. I prefer to keep Dynamic Ecology as the only place you can go to read about statistical machismo, zombie ideas, and half-baked analogies to macroeconomics. ;-)
All of the above basically amounts to me projecting my own preferences onto our readers. I’m sure in some cases I’m incorrect to do so. We did a poll a while back on what new things readers wanted to see us try, and one of the most popular options was “commentaries on newly-published papers”. So if we started doing a lot of those sorts of posts, I’ll bet lots of people would read them. But I’m just not motivated to write that sort of thing very often, and I don’t think Brian and Meg are either for the most part.
The most exciting phrase to hear in science, the one that heralds new discoveries, is not “Eureka” but “That’s funny…”
—Isaac Asimov
If you are doing science just for discovery, you are generating facts but not giving them context. (And not really doing science, either.) If you are just testing pre-existing hypotheses, you aren’t making anything new. (Engineers are just as necessary as R&D, however.) What you describe as “tinkering” is the only true science, looking at stuff we don’t already know and trying to understand it.