Home page

Deconstructing Deep Learning + δeviations

Drop me an email | RSS feed link : Click
Format : Date | Title
  TL; DR

Total posts : 78

View My GitHub Profile


Index page

Imposter Syndrome in the research community

How to deal with imposter syndrome and what causes it.

This is a repost of the blog I posted on medium. I am writing it here for sake of consistency and because it fits into the flow of this blog. Original Link

Dear Researchers,

The lockdown is over and you are standing in a line to the movies. You can feel the excitement, feel your pulse racing. Yes! This is going to be amazing. Due to high demand, seats are first come first serve. A member of the staff comes and screams that everyone can go in now. Suddenly there is absolute chaos.

7 doors, a few hundred people. Everyone starts running. In their midst, you stand paralyzed. Which door do I pick? What if… I don’t get in? By the time you start running.. it is too late. You have missed your chance. The doors slam shut in your face. Silence.

Scary?

Welcome to research.

Except, instead of 4 doors, there around about a few thousand. And people? I will not disclose the number for fear of a spike in anxiety.

Due to the huge influx in data and the raw compute available, research in every field has suddenly boomed. Below is a graph of papers published on [Arxiv] from 1992 to 2018. (Data from arxiv itself)

Oh, are you a CS major? That’s great! Care to look at 130000 papers? Oh, you only care about deep learning? Stanford HAI’s yearly [AI report] shows “just” over 7500 papers in Machine Learning alone in 2018. Wow! Just a regular Monday.

Do you now have the slow sinking feeling? How can I ever reach there? How can anything I do even be an impact on the field? Every day someone publishes something insane. A neural network that can cut paste objects from the real world? [Link]. Another that allows translation from any language to another? [Link]

Breaking it down

Okay now that you are terrified enough. Let us get to the main bit. How do we fight this fear? How do we not feel like an imposter? Like most things, it is actually quite simple. How about we first identify what causes it?

  1. Data. Sadly, we are not computers. Give me 100 papers and I will cry. Give a computer a million, it won’t even lag.

  2. Misinformation. If you have read papers/seen code, you will notice that it is almost never mentioned how long it took to make it. Neither is it mentioned how much effort it took. Ever thought about it?

  3. What else was done? This is almost funny. How many researchers publish papers on their own? Even if they do, how many do they actually get done in a year? 50? 100? 200? Or is it more realistic — 2? 5?

  4. Social media. Go to Twitter. Search for #machinelearning. Note the post. Refresh it after a few minutes. See if you can find it again. Cry :)

  5. Companies. I really admire the amazing research companies like Google/Microsoft/Neuralink etc (way too many to list) do. But funnily enough. How many times do we consider the number of people involved? How many brains do you have? (Please excuse me, time travelers).

  6. Time. This is by far the saddest. How long did it take to write paper? Sorry, I finished it overnight. I mean, over 730 nights. Oops.

Do you see the pattern? If you don’t yet. That is perfectly okay. Come back to this article in a few months. If you can find it.

Solution

Now for the main question. How can I not cry every time I open arxiv and see 100 papers with symbols from another language? <τϵαr> Here are some tips.

  1. Most research builds upon another. Try to find the differences instead. This makes it so much easier to understand.

  2. If there are a million doors. It does not matter which one you pick. There is no right or wrong. As long as you enjoy the show. And not punch your fellow audience.

  3. Please remember that you are not C-3PO. It’s perfectly okay if you don’t read those 200 papers right now. Go step by step.

  4. This is Bill. Bill uses tools like [Arxiv sanity] and [Paperscape] to not get bogged down and be able to focus. Be like Bill.

  5. Why do you code? What do you want to do? Do you want to help people of determination? Create art? Solve quantum equations? Discover new stars? Scream in greek? Hey slow down. Pick anything. Stick with it.

  6. 40 million — the number of Github users as of 2020.[Report]. You are just one of them. Do not try to be all. You can’t. Unless you are Tony Stark. And even he can only be more than 3000. (Avengers pun sorry)

  7. Seek to learn. But realize your limits.

  8. Declutter. I cannot stress enough on the importance of this. It is just as easy to be distracted by research as it is by cat memes. Stick to what you came for.

  9. Stop comparing!! It takes people years to get where they are. The only thing which happens overnight is sleep.

  10. You. Are. Enough.

Console

I am not one of the “greats”. I feel overwhelmed and scared too. I have nights where I sit and wonder if I should give up and find something easier. But then there are times when I make something I wanted to. Like a deep learning library(on the way)[Link]. Or an exhibition [Link] of endangered species powered by DL. Or even something as simple as an image restorer. These are times when I realize what I came for. I came to leave the world brighter than I found it. In my own way. I may not pick the perfect door. Or get a million likes on my posts. Or even get up every day with a smile.

But. I do go on. And I try to see that I am who I am. And I think the moment we all see that and stop losing ourselves in the huge stream of data we are force-fed, this community will be a nicer place.

Thank you,

Someone with huge dreams