From Deterministic to Generative: Multimodal Stochastic RNNs for Video Captioning

Video captioning, in essential, is a complex natural process, which is affected by various uncertainties stemming from video content, subjective judgment, and so on. In this paper, we build on the recent progress in using encoder-decoder framework for video captioning and address what we find to be a critical deficiency of the existing...

Engineering NADH/NAD⁺ ratio in Halomonas bluephagenesis for enhanced production of polyhydroxyalkanoates (PHA)

Halomonas bluephagenesis has been developed as a platform strain for the next generation industrial biotechnology (NGIB) with advantages of resistances to microbial contamination and high cell density growth (HCD), especially for production of polyhydroxyalkanoates (PHA) including poly(3-hydroxybutyrate) (PHB), poly(3-hydroxybutyrate-co-4...

Matching images and text with multi-modal tensor fusion and re-ranking

A major challenge in matching images and text is that they have intrinsically different data distributions and feature representations. Most existing approaches are based either on embedding or classification, the first one mapping image and text instances into a common embedding space for distance measuring, and the second one regarding...

Unified Binary Generative Adversarial Network for Image Retrieval and Compression

Binary codes have often been deployed to facilitate large-scale retrieval tasks, but not that often for image compression. In this paper, we propose a unified framework, BGAN+, that restricts the input noise variable of generative adversarial networks to be binary and conditioned on the features of each input image, and simultaneously learns...

A 1.66Gb/s and 5.8pJ/b Transcutaneous IR-UWB Telemetry System with Hybrid Impulse Modulation for Intracortical Brain-Computer Interfaces

Intra-cortical extracellular neural sensing is being rapidly and widely applied in several clinical research and brain-computer interfaces (BCIs), as the number of sensing channels continues to double every 6 years. By distributing multiple high-density extracellular micro-electrode arrays (MEAs) in vivo across the brain, each with 1000's of...