Asad Islam

Efficient Algorithms for Editing H.263 and MPEG-4 Videos on Mobile Terminals

With the prevalence of hand-held devices equipped with digital cameras and capable of capturing long videos, there has been a substantial increase in the creation and availability of video content. Most of the video clips that are created are, however, unprofessional in quality. Video editing tools are used to fine-tune, clean and refine the captured video content. While such clips can be edited on PC, it is inconvenient tedious and sometimes impossible to transfer files between mobile device and PC. It is, therefore, more convenient for users to edit their videos on their mobile devices. On the other hand, with the constraints in processing power and memory in hand-held devices, spatial domain editing is not practical. However, compressed domain editing solutions can overcome such limitations. In this paper, we present efficient, compressed domain algorithms for video editing, which when tested on mobile devices, provide significant savings in computations compared to the conventional spatial domain approach.

Video and Audio Editing for Mobile Applications

Video content creation and consumption have been increasingly available for the masses with the emergence of handheld devices capable of shooting, downloading, and playing videos. Video editing is a natural and necessary operation that is most commonly employed by users for finalizing and organizing their video content. With the constraints in processing power and memory, conventional spatial domain video editing is not a solution for mobile applications. In this paper, we present a complete video editing system for efficiently editing video content on mobile phones using compressed domain editing algorithms. A critical factor from usability point of view is the processing speed of the editing application. We show that with the proposed compressed domain editing system, typical video editing operations can be performed much faster than real-time on todays S60 phones

Compressed domain editing of H.263 and MPEG-4 videos

Video content creation and production has reached the masses, as almost everyone is now able to create video dips on a daily basis. Video editing is a natural and necessary operation that is most commonly employed by users after video capture. Wireless imaging and video capturing devices, with hardware constraints of memory and processing power, are unable to accommodate conventional spatial domain video editing. In this paper we present a set of algorithms for efficiently performing editing effects on video content. The proposed algorithms, covering intra and inter sequence operations, are applied on H.263 and MPEG-4 compressed video sequences. The techniques ensure that the desired effects are achieved generating standard compliant codestreams, with significant savings in computations compared to the convention approach based on spatial domain editing.

Compressed domain transcoding solutions for MPEG-4 visual simple profile and H.263 baseline videos in 3GPP services and applications

To provide basic video services and applications in 3G wireless networks, two video coding formats, H.263 baseline and MPEG-4 visual simple profile, are commonly adopted in different forms for various usage scenarios. To ensure interoperability between these cases, we propose efficient compressed domain algorithms for transcoding between MPEG-4 visual simple profile and H.263 baseline, and among MPEG-4 visual simple profile coding modes. Experimental results show that our suggested algorithms provide significant complexity reduction and quality improvement, in terms of PSNR, compared to the spatial domain approach. Being the first complete work on transcoding between all kinds of MPEG-4 visual simple profile and H.263 baseline bit streams, we believe this work provides valuable solutions for various 3GPP (3rd generation partnership project) compliant video services and applications).

Compressed domain editing of JPEG2000 images

To process or introduce editing effects on JPEG2000 images, we propose techniques applying these operations in the compressed domain. Our approach exploits the properties of the wavelet transform and the rich bitstream syntax of the JPEG2000 standard. The suggested techniques provide significant speed-ups compared to the conventional methods based on spatial domain processing of the decoded images.

Block based embedded color image and video coding

Set Partitioned Embedded bloCK coder (SPECK) has been found to perform comparable to the best-known still grayscale image coders like EZW, SPIHT, JPEG2000 etc. In this paper, we first propose Color-SPECK (CSPECK), a natural extension of SPECK to handle color still images in the YUV 4:2:0 format. Extensions to other YUV formats are also possible. PSNR results indicate that CSPECK is among the best known color coders while the perceptual quality of reconstruction is superior than SPIHT and JPEG2000. We then propose a moving picture based coding system called Motion-SPECK with CSPECK as the core algorithm in an intra-based setting. Specifically, we demonstrate two modes of operation of Motion-SPECK, namely the constant-rate mode where every frame is coded at the same bit-rate and the constant-distortion mode, where we ensure the same quality for each frame. Results on well-known CIF sequences indicate that Motion-SPECK performs comparable to Motion-JPEG2000 while the visual quality of the sequence is in general superior. Both CSPECK and Motion-SPECK automatically inherit all the desirable features of SPECK such as embeddedness, low computational complexity, highly efficient performance, fast decoding and low dynamic memory requirements. The intended applications of Motion-SPECK would be high-end and emerging video applications such as High Quality Digital Video Recording System, Internet Video, Medical Imaging etc.

JPEG 2000 for wireless applications

JPEG2000 is the new ISO/IEC image compression standard. It is a full coding system targeted for various imaging applications. Besides offering the state-of-the-art in still image compression, it provides new features such as scalability in quality and in resolution, random access and region of interest (ROI) coding. Motion JPEG2000 is an inherited video compression standard based on intra-farme coding using JPEG2000. JPIP (the JPEG2000 Interactive Protocol), is a developing protocol for the access and transmission of JPEG2000 coded data and related metadata in a networked environment. In this paper, we present various applications of JPEG2000, Motion JPEG2000 and JPIP, geared specially towards the wireless mobile environment. We present an Image Surfing system for surfing JPEG2000 images on mobile terminals over a wireless network. We also present a scheme for tracking and coding Regions-Of-Interest (ROI) over a Motion JPEG2000 sequence. Finally, we present a Partial Coding scheme for use in Motion JPEG2000 sequences that gives coding gains for certain types of video sequences.