This paper proposes a new framework called VCode and VData to support the video annotation workflow. The framework is designed to address limitations of existing tools such as poor support for the full annotation process, poor representation of data on a timeline, and poor interaction techniques. VCode and VData were created based on design requirements identified from interviews with experienced coders and researchers. The tools aim to optimize the annotation workflow, synchronize video and annotations, capture different data types, display additional sensor data to aid coding, support multiple playback modes, and make reliability calculations and review of annotations easier.