Its basically a microscope? Fluorescently labelled organelles?
Sequencing by Synthesis - basically chemistry/enzymes that fluoresces in different colors depending on which base is added and millions of strands being synthesized in parallell in one microscopy frame.
It’s a fluorescent microscope with picture scanning. This is one segment of a slide (flow chip) that we scanned last weekend:
You can see the DNA clusters (dots) and some other crap (did not pay much attention on cleaning). Don’t know what the different lines are…
And it is just one tile of the whole image. The slide is scanned with 6x16 tiles per lane and 8 lanes.
The pictures of each tile are 2000x10’000 pixels at 16bit
Let’s put some tardigrades in the flow channels and make a huge poster…
The DB9 in the camera board is for power. In the HiSeq controller (as shown in the image above) has the DB9 power output for the camera. If someone with the controller can measure the voltage output of the DB9 pins, one can find out the power required to drive this camera control board.
Christopher Burge at Stanford University in California hacked an Illumina sequencer to measure protein–DNA interactions at very high throughput. Nice.
“The GAII is basically a pumping system that pumps things onto the flow cell and then onto a fancy imaging system,”
This project is building a board for sequencing using Ion Personal Genome Machine chips.
First of all, thanks for documenting what you have done. It’s a fantastic resource. I’m interested in re-purposing the microscope from a HiSeq2500 and was wondering if you have made available the control software mentioned here:
With many of the commands known it is possible to use the HiSeq2000 as a transmission or fluorescent scanning microscope. We developed a simple control software based on PureData to send commands to the HiSeq control hardware and get images from the scanning microscope. To view, set-up and read the scanner cameras we used HCImage software and TDIScan tool both available for free from Hamamatsu.
I have found a couple of engineering students to work on it over the (Australian) summer holidays and if they could use what you have already done as a starting point that would be awesome. Details of your illumination for transmission imaging would also be good if you have anything you can put up. My goal was to see if they could get it integrated into https://micro-manager.org/ which would make it accessible to the microscope community more generally. Any thoughts you might have on what problems we may encounter would be much appreciated.
Great to hear you want to re-purposing your HiSeq2500 together with your students. I updated the wiki with a link to the PureData Sketch and the scan sequence. It’s a hack and not easy to get to work. Also you will have to see if it’s compatible with the 2500. Feel free to ask if you are stuck. A better, easy to use software would be great and I am happy to help. All the commands we need are here I guess. You will have to call DCAM API commands to do the picture grabbing (not sure if this is possible in Micro-Manager).
Great, thanks Urs. The two instruments are similar. The 2500 we have was upgraded from a 2000.
Micromanager can talk to various Hamamatsu cameras through the DCAM-API so I am hopeful.
If we can get MM talking to all the bits then ImageJ can serve as a front end or the instrument could just be driven using scripts: https://micro-manager.org/wiki/Micro-Manager_Project_Overview-new
I haven’t had a good look at the stage yet but I notice there’s some electronics and a couple of cooling blocks. Do you know what’s generating the heat? I notice there’s a patent for the whole unit but haven’t yet been able to bring myself to try and decode it.
Sounds promising. You would need to do a TDI (time delay integration) scan with external trigger. Can Micromanager do that. Or then this would be a good plug-in to add
Hi to all,
after i posted that comments about the HiSeq components three years ago to that “Illumina GAIIx Teardown” blog at swarthmore.edu i was surprised how many mails i received over the following months and years from several work groups where people were trying to do new things with old HiSeqs. I provided technical documentation and help in questions how to reverse protocols hard- and software. My own efforts here with my three HiSeqs were delayed due to my work load here at my institute therefore i did not finish the communication with the TDI line scanner. One is still complete, two others i completely emptied to reuse parts. The space was needed by the institute
Then just three months ago i was pointed to this documentation you did here and was even more surprised, this is really a nice community that has been formed to collect the infos needed! Today i found the updates with the successful scans of transmission and fluorescence images. That’s nice, I think there is no need to reverse the scanner part from scratch anymore
Older platforms like the ABI Solid i hacked before were nearly completely cobbled together from commercial of the shelf components and very easy to reuse and to modify both in hard and software. I think the time-to-market was the most important thing for the competing companies back then so the construction from R&D was nearly unchanged sold - with a nice compartment around.
In the HiSeq is a little more custom electronics/firmware (especially in the FPGA part, also a little bit in the ARM controller) but still open enough to be reused and modified, maybe completely. Only if you need to change filters to adapt to alternative fluophores like described in various papers on protocols on “hacked” Illumina GA IIx it can be mandantory to perform some readjustments to the optical bench - e.g. beam expander.
The NovaSeq is even more customized and closed - i was not able yet to reverse engineer one of them but had my nose deeeep inside while one of them was set up in our lab two weeks ago.
I hope i can contribute something to this HiSeq 2000/2500 reversing in the future, maybe write a control software to replace the Illumina and Hamamatsu Software needed - beside the API of course. Limiting factor here is really time but working together this can be quicker.
Best from Kiel (Germany),
That will be one for the students to look into. Cameras are handled by things called DeviceAdaptors:
For hamamatsu cameras this looks like a wrapper around the DCAM API. Unfortunately there’s no source for some of them - including DCAM.
I mentioned there that I am currently available for software and electronics contract work and interested in scientific equipment and very much interested in open sourcing stuff.
So to respond here, rather than clutter up the other thread. I think a WeMakeIt campaign set up by me would make sense then even if @gaudi is the only one to pledge. But it does seem like there are others here interested that could potentially contribute too.
I’d be happy to travel or even relocate for a while to be near a machine or we could budget in buying another machine or sending one to the UK: whatever makes the most sense.
All the details need to be worked out of course. I need to be sure I am capable of doing all the work or able to get help. How we could collaborate (@jmarkham) and the exact budget needs to be worked out too, but how would people feel about contributing towards this work in the form of a WeMakeIt campaign in general?
Unfortunately I can’t commit money at this point (I will ask around though) but I am keen to co-ordinate. At the start of December two elec-eng students are coming to do an internship subject over their summer holidays (about 12 weeks). The reason I have the hi-seq is that it broke and the fault seems to be in the main controller box, so depending on whether this can be addressed, we may end up using a subset of the hardware. (I haven’t had a chance to look harder. Some back story is that I work at a cancer hospital doing clinical genomics and this is just something that they tolerate me doing on the side.)
In terms of overall goals, if the hi-seq can be driven by micro-manager then this makes it available to a wide range of users in the microscope community and I’d love to be able to contribute to that. My personal interest is to use it to look at cells and their labelled dsDNA molecules on a custom microfluidics chip. At the moment I have the use of an old Zeiss Axiovert 200m for development work but the hi-seq would actually be more suitable if it worked.
Depending on subject area, @tboysen and @gaudi, the possibility exists to host and supervise students at PeterMac, WEHI should that be of interest. Conversely, if you have any opportunities, I’m happy to make enquiries at this end to facilitate. I’ll be in Europe for Christmas and until 12/1. Are you guys gonna be at work over any of that time?
Hi John (and all others here),
i think the way to control a (intact!) hiseq with a alternative Software to use for microscopy and even quantitative fluorescence measurements is not that long. I see most of the needed information is already there. OK, i know, it’s easy just to say this but harder to actually do it - i’m sure obstacles are lurking on the way i can’t see at the moment.
I assumed the most problems to control the line scanner with all it’s features, it was the last component left to reverse. But it’s possible to reuse the Hamamatsu software components you find in a Illuina installation. However, i did not found the time to test it yet and check out how much of the image processing is done in hamamatsu and Illumina binaries. And i don’t know if there are licence problems in the end when reusing software that came bundled with the illumina software here - hopefully not if it’s just science we do.
My main problem here at the moment holding me back from really contributing is time. I’m also working at a clinical genomics institute both technically and in research and it’s just too much at the moment. But my technical things and the hiseq hacks in the basements are tolerated here too, maybe because i build new microfluidic lab machines from the junk i treasured up from generations of sequences from ALF over Roche and ABI to Illumina.
To @jmarkham… if you can provide me some informations about what problems the control box is making maybe i can find out where to search and even send you the spare parts to get your project running, i have three sets here - minus one fluidic control board where the ARM controller died while connected to the JTAG adapter. First time that happened for me, don’t know what i did wrong. (BTW: The valves and drivers are already prepared to send to you, just drop me a mail with the address to ship to via private mail.)
Best from Kiel,
Happy to see this project taking some momentum.
Technically I am sure @kaspar you can do it. I have made a working prototype of a software in PureData . I know how to control all the elements in the machine (lasers, filter motors, x/y motors etc). For the scanning I know the commands to trigger scanning in the FPGA and I can take pictures with the Hamamatsu TDI demo program. ( documented here: https://www.hackteria.org/wiki/HiSeq2000_-_Next_Level_Hacking , maybe some things need to me explained more, I am happy to do that).
So what would needs to be done:
Better graphical interface. With some sliders, knobs, speed settings, preview window, maybe selecting scanning area by mouse, choosing the camera and filters etc.
Opening 6 serial ports (for the different units) and sending the corresponding commands. The commands are text based (see command list on the wiki) and as easy as “LASER ON” “LASER OFF”.
Reading the picture form the frame grabber. I now do this with the Hamamatsu TDI demo software. It works. However I think it would be a big improvement to integrate this with the control software. The pictures could be previewed in the interface. Automatic scanning etc would be possible. For this we would need to interface with the framgrabber via the DCAM Interface Library. The library is openly available from Hamamatsu and probably well documented.
Post processing of some (BIG) images. This is kind of optional as it can be done in ImageJ. Would be nice to stitch scanned lines together into one big picture automatically. Probably more a question on how to program it properly and the power of your computer.
Extra features: Once the basic software is running there are - as always - endless improvements that could be made, such as auto-focusing, combining fluorescent images with bright light etc etc.
Integration into Micromanager sound interesting if possible with the machine we have. (As I said earlier the TDI scanning must be solved as it is probably not standard in this software). Also we have to consider what is easier (stand alone or integration) and flexibility for other uses - I can still imagine to do some sequencing with the open software (by integrating the flushing of the chips with the chemicals between images, so would need to control some valves and pumps) - or also turn the machine into a flow cytometer…
For the WeMakeIt campaign, I also think it might be an easy way to get some extra money. Need to setup a description and a video - probably us talking something and some images from the prototype. Then administratively its very lean, you basically just get the money. Maybe we need to think of a simple use case to include in the campaign. Such as finding micro-plastic in soil (what we allready tried). We can then spread the word and hopefully find some more people that have a HiSeq and want to reuse it. (And yes, GaudiLabs would just be a gold sponsor of the project).
** Have to check, I think this science booster ends soon, maybe already end of this year. So let’s do in now**
For working on the machine. Ask around, these machines are available at sequencing labs and universities, so if you could get one @kaspar that would be fun. Probably the crowd-funding campaign would even help getting more machines if we mention that we need some for you. (Institutions payed millions for these machines only some years ago and they are sad to see them be without use alread.y)
Then it would probably be good if you could come to GaudiLabs, @kaspar and @jmarkham so that I can show you the scanning and transfer as much knowledge from my hack to you. Between Chrismas and NewYear would be good for me (I will skip CCC or maybe we can even meet there). Best if we already have to money by then.
Yes Urs, seeing this momentum makes fun! I hope with the combination of the different emphases in experience (coding, reverse engineering, electronics, lab…) of the people here it will be a project with an productive outcome soon.
My expertise that could be of help is mainly in electronics, embedded computing & reverse engineering and i have experience in the work with laser optics. I will help whenever i can. My problem here is time, because i have too many projects to do for the institute, my private ones are just slowed down to a hold, i even did not finished the project with the ABI Solid components yet that started before the Hiseq hack.
One of the three Hiseq 2000 i could prey in 2015 is still complete. The director of the institute is planning to put it in the lobby as display model - therefore i already added a window for a direct view on the illuminated optical bench and wrote software for an Atmel controller to recreate the light show (it’s a TLC5947 LED driver behind that LED bar). So i could reactivate that machine, i have to install a new control PC because the old ones were reused as a small cluster. And i have the components from the other two, so if something breaks i can provide spare parts.
As newer sequencers are replacing the Hiseqs more and more in the sense of running costs it’s just a question of time when the next Hiseq is avaliable for me “to play with” - i would transport that to you (i think you’re located in south germany?) if it’s needed to complete this project. I will ask when the next one is trown out. How short-lived they are, just crazy…
Good to know, spare parts can be helpful. I once broke a silicon damper on my machine and had a hard time to fix it. Also laser and optics knowledge is important. The fluorescent images that I took are kind of unevenly lit and have stripes. Still not sure where this comes from, maybe we can find out. The big LED bar on the machine can be controlled with simple commands via the FPGA virtual serial port (see command list).
@kaspar if you want to start testing with the camera DCAM library - I have an extra camera unit that I could send you. If you get one of the HiSeq framegrabber cards you could already start experimenting with it.
just wanted to say that I am very much interested in helping out in any way I can - and I guess reverse engineering of software and hardware. as well as software engineering would probably be where i could contribute the most at this time.
Also eager to get my hands on a Hiseq to play around with and would have space for it in my studio in Berlin so if you hear of any orphaned Hiseqs out there looking for a new home let me know
I’ve been following this thread, it’s off my core focus but is really interesting. I’m more of a phone talker… is anyone willing to have a 30 minute conversation with me about how this works? I’m curious to know if we could use the Our Sci platform to manage communications + output from the HiSeq… that would reduce the overhead of creating input/output software to the device, and create an interesting application for us that we may actually be able to use in our paid work (which means we can contribute more consistently to make it useful for this application).
First simple question - does the data go in and out via USB serial? If so, then I’d love to hear more. If not, maybe not a good fit.
It may not be a good fit which is ok, but I’d like to explore it.
Any takers on a call with me so I can pepper you with questions