Multi level Motion Attention for Human Motion Prediction. Human motion prediction aims to forecast future human poses given a historical motion. Whether based on recurrent or feed forward neural networks, existing learning based methods fail to model the observation that human motion tends to repeat itself, even for complex sports actions and cooking activities. Here, we introduce an attention based feed forward network that explicitly leverages this observation. In particular, instead of modeling frame wise attention via pose similarity, we propose to extract motion attention to capture the similarity between the current motion context and the historical motion sub sequences. In this context, we study the use of different types of attention, computed at joint, body part, and full pose levels. Aggregating the relevant past motions and processing the result with a graph convolutional network allows us to effectively exploit motion patterns from the long term history to predict the future poses. Our experiments on Human3.6M, AMASS and 3DPW validate the benefits of our approach for both periodical and non periodical actions. Thanks to our attention model, it yields state of the art results on all three datasets. Our code is available at https github.com wei mao 2019 HisRepItself.


A Case Study of Vehicle Route Optimization. In the last decades, the classical Vehicle Routing Problem (VRP), i.e., assigning a set of orders to vehicles and planning their routes has been intensively researched. As only the assignment of order to vehicles and their routes is already an NP complete problem, the application of these algorithms in practice often fails to take into account the constraints and restrictions that apply in real world applications, the so called rich VRP (rVRP) and are limited to single aspects. In this work, we incorporate the main relevant real world constraints and requirements. We propose a two stage strategy and a Timeline algorithm for time windows and pause times, and apply a Genetic Algorithm (GA) and Ant Colony Optimization (ACO) individually to the problem to find optimal solutions. Our evaluation of eight different problem instances against four state of the art algorithms shows that our approach handles all given constraints in a reasonable time.


Representation Learning via Global Temporal Alignment and Cycle Consistency. We introduce a weakly supervised method for representation learning based on aligning temporal sequences (e.g., videos) of the same process (e.g., human action). The main idea is to use the global temporal ordering of latent correspondences across sequence pairs as a supervisory signal. In particular, we propose a loss based on scoring the optimal sequence alignment to train an embedding network. Our loss is based on a novel probabilistic path finding view of dynamic time warping (DTW) that contains the following three key features (i) the local path routing decisions are contrastive and differentiable, (ii) pairwise distances are cast as probabilities that are contrastive as well, and (iii) our formulation naturally admits a global cycle consistency loss that verifies correspondences. For evaluation, we consider the tasks of fine grained action classification, few shot learning, and video synchronization. We report significant performance increases over previous methods. In addition, we report two applications of our temporal alignment framework, namely 3D pose reconstruction and fine grained audio visual retrieval.


Shape optimization of a thermal insulation problem. We study a shape optimization problem involving a solid K subset mathbb R n that is maintained at constant temperature and is enveloped by a layer of insulating material Omega which obeys a generalized boundary heat transfer law. We minimize the energy of such configurations among all (K, Omega) with prescribed measure for K and Omega , and no topological or geometrical constraints. In the convection case (corresponding to Robin boundary conditions on partial Omega ) we obtain a full description of minimizers, while for general heat transfer conditions, we prove the existence and regularity of solutions and give a partial description of minimizers.


Exploiting Learned Symmetries in Group Equivariant Convolutions. Group Equivariant Convolutions (GConvs) enable convolutional neural networks to be equivariant to various transformation groups, but at an additional parameter and compute cost. We investigate the filter parameters learned by GConvs and find certain conditions under which they become highly redundant. We show that GConvs can be efficiently decomposed into depthwise separable convolutions while preserving equivariance properties and demonstrate improved performance and data efficiency on two datasets. All code is publicly available at github.com Attila94 SepGrouPy.


IterMVS Iterative Probability Estimation for Efficient Multi View Stereo. We present IterMVS, a new data driven method for high resolution multi view stereo. We propose a novel GRU based estimator that encodes pixel wise probability distributions of depth in its hidden state. Ingesting multi scale matching information, our model refines these distributions over multiple iterations and infers depth and confidence. To extract the depth maps, we combine traditional classification and regression in a novel manner. We verify the efficiency and effectiveness of our method on DTU, Tanks Temples and ETH3D. While being the most efficient method in both memory and run time, our model achieves competitive performance on DTU and better generalization ability on Tanks Temples as well as ETH3D than most state of the art methods. Code is available at https github.com FangjinhuaWang IterMVS.


Geodesic complexity of homogeneous Riemannian manifolds. We study the geodesic motion planning problem for complete Riemannian manifolds and investigate their geodesic complexity, an integer valued isometry invariant introduced by D. Recio Mitter. Using methods from Riemannian geometry, we establish new lower and upper bounds on geodesic complexity and compute its value for certain classes of examples with a focus on homogeneous Riemannian manifolds. Methodically, we study properties of stratifications of cut loci and use results on their structures for certain homogeneous manifolds obtained by T. Sakai and others.


Privacy Preserving Identification of Target Patients from Outsourced Patient Data. With the increasing affordability and availability of patient data, hospitals tend to outsource their data to cloud service providers (CSPs) for the purpose of storage and analytics. However, the concern of data privacy significantly limits the data owners' choice. In this work, we propose the first solution, to the best of our knowledge, that allows a CSP to perform efficient identification of target patients (e.g., pre processing for a genome wide association study GWAS) over multi tenant encrypted phenotype data (owned by multiple hospitals or data owners). We first propose an encryption mechanism for phenotype data, where each data owner is allowed to encrypt its data with a unique secret key. Moreover, the ciphertext supports privacy preserving search and, consequently, enables the selection of the target group of patients (e.g., case and control groups). In addition, we provide a per query based authorization mechanism for a client to access and operate on the data stored at the CSP. Based on the identified patients, the proposed scheme can either (i) directly conduct GWAS (i.e., computation of statistics about genomic variants) at the CSP or (ii) provide the identified groups to the client to directly query the corresponding data owners and conduct GWAS using existing distributed solutions. We implement the proposed scheme and run experiments over a real life genomic dataset to show its effectiveness. The result shows that the proposed solution is capable to efficiently identify the case control groups in a privacy preserving way.


The Hammer and the Nut Is Bilevel Optimization Really Needed to Poison Linear Classifiers?. One of the most concerning threats for modern AI systems is data poisoning, where the attacker injects maliciously crafted training data to corrupt the system's behavior at test time. Availability poisoning is a particularly worrisome subset of poisoning attacks where the attacker aims to cause a Denial of Service (DoS) attack. However, the state of the art algorithms are computationally expensive because they try to solve a complex bi level optimization problem (the "hammer"). We observed that in particular conditions, namely, where the target model is linear (the "nut"), the usage of computationally costly procedures can be avoided. We propose a counter intuitive but efficient heuristic that allows contaminating the training set such that the target system's performance is highly compromised. We further suggest a re parameterization trick to decrease the number of variables to be optimized. Finally, we demonstrate that, under the considered settings, our framework achieves comparable, or even better, performances in terms of the attacker's objective while being significantly more computationally efficient.


Safe Driving via Expert Guided Policy Optimization. When learning common skills like driving, beginners usually have domain experts standing by to ensure the safety of the learning process. We formulate such learning scheme under the Expert in the loop Reinforcement Learning where a guardian is introduced to safeguard the exploration of the learning agent. While allowing the sufficient exploration in the uncertain environment, the guardian intervenes under dangerous situations and demonstrates the correct actions to avoid potential accidents. Thus ERL enables both exploration and expert's partial demonstration as two training sources. Following such a setting, we develop a novel Expert Guided Policy Optimization (EGPO) method which integrates the guardian in the loop of reinforcement learning. The guardian is composed of an expert policy to generate demonstration and a switch function to decide when to intervene. Particularly, a constrained optimization technique is used to tackle the trivial solution that the agent deliberately behaves dangerously to deceive the expert into taking over. Offline RL technique is further used to learn from the partial demonstration generated by the expert. Safe driving experiments show that our method achieves superior training and test time safety, outperforms baselines with a substantial margin in sample efficiency, and preserves the generalizabiliy to unseen environments in test time. Demo video and source code are available at https decisionforce.github.io EGPO


A Probabilistic Framework for Knowledge Graph Data Augmentation. We present NNMFAug, a probabilistic framework to perform data augmentation for the task of knowledge graph completion to counter the problem of data scarcity, which can enhance the learning process of neural link predictors. Our method can generate potentially diverse triples with the advantage of being efficient and scalable as well as agnostic to the choice of the link prediction model and dataset used. Experiments and analysis done on popular models and benchmarks show that NNMFAug can bring notable improvements over the baselines.


Domain Adaptation of Networks for Camera Pose Estimation Learning Camera Pose Estimation Without Pose Labels. One of the key criticisms of deep learning is that large amounts of expensive and difficult to acquire training data are required in order to train models with high performance and good generalization capabilities. Focusing on the task of monocular camera pose estimation via scene coordinate regression (SCR), we describe a novel method, Domain Adaptation of Networks for Camera pose Estimation (DANCE), which enables the training of models without access to any labels on the target task. DANCE requires unlabeled images (without known poses, ordering, or scene coordinate labels) and a 3D representation of the space (e.g., a scanned point cloud), both of which can be captured with minimal effort using off the shelf commodity hardware. DANCE renders labeled synthetic images from the 3D model, and bridges the inevitable domain gap between synthetic and real images by applying unsupervised image level domain adaptation techniques (unpaired image to image translation). When tested on real images, the SCR model trained with DANCE achieved comparable performance to its fully supervised counterpart (in both cases using PnP RANSAC for final pose estimation) at a fraction of the cost. Our code and dataset are available at https github.com JackLangerman dance


High Performance GPU Code Generation for Matrix Matrix Multiplication using MLIR Some Early Results. This report presents some early results on code generation targeting tensor cores on NVIDIA GPUs using the MLIR compiler infrastructure. The state of the art in high performance deep learning today is primarily driven by manually optimized highly tuned libraries. The approach to develop such libraries is often not modular or reusable to the same extent that compiler infrastructure like LLVM is. Manual optimization typically does not use a standard intermediate representation (IR), although the optimizations performed can be encoded as a sequence of transformation steps and customized passes on an IR. Hand tuning may also miss exploration of design points only reachable easily by automatic code generation. We believe that until the recent introduction of MLIR (Multi level intermediate representation), IR infrastructure was not geared to tackle the problem of automatic generation of domain specific libraries in an effective manner. In particular, it was hard to represent and transform compute abstractions at high, middle, and low levels using a single IR. With suitable abstractions in MLIR, we build an experimental lowering pipeline that is able to automatically generate code for matrix matrix multiplication on NVIDIA GPUs targeting its tensor cores. On a set of problem sizes we evaluated, initial performance results show that we are able to attain performance that is 95 119 and 80 160 of CuBLAS for FP32 and FP16 accumulate respectively on NVIDIA's Ampere microarchitecture based Geforce 3090 RTX. We believe that these results could be used as motivation for further research and development on automatic code and library generation using IR infrastructure for similar specialized accelerators.


MLPruning A Multilevel Structured Pruning Framework for Transformer based Models. Pruning is an effective method to reduce the memory footprint and computational cost associated with large natural language processing models. However, current approaches either only explore head pruning, which has a limited pruning ratio, or only focus on unstructured pruning, which has negligible effects on the real inference time and or power consumption. To address these challenges, we develop a novel MultiLevel structured Pruning (MLPruning) framework, which uses three different levels of structured pruning head pruning, row pruning, and block wise sparse pruning. We propose using a learnable Top k threshold, which employs an adaptive regularization to adjust the regularization magnitude adaptively, to select appropriate pruning ratios for different weight matrices. We also propose a two step pipeline to combine block wise pruning with head row pruning to achieve high structured pruning ratios with minimum accuracy degradation. Our empirical results show that for bertbase, with textapprox20 of remaining weights, OURS can achieve an accuracy that is comparable to the full model on QQP MNLI squad, with up to textapprox3.69x speedup. Our framework has been open sourced cite codebase .


Pore scale Simulation of Shear Thinning Fluid Flow using Lattice Boltzmann Method. Present work attempts to identify the roles of flow and geometric variables on the scaling factor which is a necessary parameter for modeling the apparent viscosity of non Newtonian fluid in porous media. While idealizing the porous media microstructure as arrays of circular and square cylinders, present study uses multi relaxation time lattice Boltzmann method to conduct pore scale simulation of shear thinning non Newtonian fluid flow. Variation in the size and inclusion ratio of the solid cylinders generates wide range of porous media with varying porosity and permeability. Present study also used stochastic reconstruction technique to generate realistic, random porous microstructures. For each case, pore scale fluid flow simulation enables the calculation of equivalent viscosity based on the computed shear rate within the pores. It is observed that the scaling factor has strong dependence on porosity, permeability, tortuosity and the percolation threshold, while approaching the maximum value at the percolation threshold porosity. Present investigation quantifies and proposes meaningful correlations between the scaling factor and the macroscopic properties of the porous media.


Necessary conditions for blow up solutions to the restricted Euler Poisson equations. In this work, we study the behavior of blow up solutions to the multidimensional restricted Euler Poisson equations which are the localized version of the full Euler Poisson system. We provide necessary conditions for the existence of finite time blow up solutions in terms of the initial data, and describe the asymptotic behavior of the solutions near blow up times. We also identify a rich set of the initial data which yields global bounded solutions.


Hamilton Paths in Dominating Graphs of Trees and Cycles. The dominating graph of a graph H has as its vertices all dominating sets of H , with an edge between two dominating sets if one can be obtained from the other by the addition or deletion of a single vertex of H . In this paper we prove that the dominating graph of any tree has a Hamilton path. We also show how a result about binary strings leads to a proof that the dominating graph of a cycle on n vertices has a Hamilton path if and only if n not equiv 0 pmod 4 .


Optimal Transport between Gaussian random fields. We consider the optimal transport problem between zero mean Gaussian stationary random fields both in the aperiodic and periodic case. We show that the solution corresponds to a weighted Hellinger distance between the multivariate and multidimensional power spectral densities of the random fields. Then, we show that such a distance defines a geodesic, which depends on the weight function, on the manifold of the multivariate and multidimensional power spectral densities.


Fed LAMB Layerwise and Dimensionwise Locally Adaptive Optimization Algorithm. In the emerging paradigm of federated learning (FL), large amount of clients, such as mobile devices, are used to train possibly high dimensional models on their respective data. Due to the low bandwidth of mobile devices, decentralized optimization methods need to shift the computation burden from those clients to the computation server while preserving privacy and reasonable communication cost. In this paper, we focus on the training of deep, as in multilayered, neural networks, under the FL settings. We present Fed LAMB, a novel federated learning method based on a layerwise and dimensionwise updates of the local models, alleviating the nonconvexity and the multilayered nature of the optimization task at hand. We provide a thorough finite time convergence analysis for Fed LAMB characterizing how fast its gradient decreases. We provide experimental results under iid and non iid settings to corroborate not only our theory, but also exhibit the faster convergence of our method, compared to the state of the art.


New bounds for Stein's square functions in higher dimensions. We improve the L p( mathbb R n) bounds on Stein's square function to the best known range of the Fourier restriction problem when n geq4 . Applications including certain local smoothing estimates are also discussed.


A source reconstruction method in two dimensional radiative transport using boundary data measured on an arc. We consider an inverse source problem in the stationary radiating transport through a two dimensional absorbing and scattering medium. Of specific interest, the exiting radiation is measured on an arc. The attenuation and scattering properties of the medium are assumed known. For scattering kernels of finite Fourier content in the angular variable, we show how to quantitatively recover the part of the isotropic sources restricted to the convex hull of the measurement arc. The approach is based on the Cauchy problem with partial data for a Beltrami like equation associated with A analytic maps in the sense of Bukhgeim, and extends authors' previous work to this specific partial data case. The robustness of the method is demonstrated by the results of several numerical experiments.


2 Cartesian fibrations I A model for infty bicategories fibred in infty bicategories. In this paper, we provide a notion of infty bicategories fibred in infty bicategories which we call 2 Cartesian fibrations. Our definition is formulated using the language of marked biscaled simplicial sets Those are scaled simplicial sets equipped with an additional collection of triangles containing the scaled 2 simplices, which we call lean triangles, in addition to a collection of edges containing all degenerate 1 simplices. We prove the existence of a left proper combinatorial simplicial model category whose fibrant objects are precisely the 2 Cartesian fibrations over a chosen scaled simplicial set S . Over the terminal scaled simplicial set, this provides a new model structure modeling infty bicategories, which we show is Quillen equivalent to Lurie's scaled simplicial set model. We conclude by providing a characterization of 2 Cartesian fibrations over an infty bicategory. This characterization then allows us to identify those 2 Cartesian fibrations arising as the coherent nerve of a fibration of operatorname Set Delta enriched categories, thus showing that our definition recovers the preexisting notions of fibred 2 categories.


Using thermo optical nonlinearity to robustly separate absorption and radiation losses in nanophotonic resonators. Low loss nanophotonic resonators have been widely used in fundamental science and applications thanks to their ability to concentrate optical energy. Key for resonator engineering, the total intrinsic loss is easily determined by spectroscopy, however, quantitatively separating absorption and radiative losses is challenging. While the concentrated heat generated by absorption within the small mode volume results in generally unwanted thermo optical effects, they can provide a way for quantifying absorption. Here, we propose and experimentally demonstrate a technique for separating the loss mechanisms with high confidence using only linear spectroscopic measurements. We use the optically measured resonator thermal time constant to experimentally connect the easily calculable heat capacity to the thermal impedance, needed to calculate the absorbed power from the temperature change. We report the absorption, radiation, and coupling losses for ten whispering gallery modes of three different radial orders on a Si microdisk. Similar absorptive loss rates are found for all the modes, despite order of magnitude differences in the total dissipation rate due to widely differing radiation losses. Measuring radiation losses of many modes enables distinguishing the two major components of radiation loss originating from scattering and leakage. The all optical characterization technique is applicable to any nanophotonic resonators subject to thermo optical effects.


Metal Fillers as Potential Low Cost Countermeasure against Optical Fault Injection Attacks. Physically accessible devices such as sensor nodes in Wireless Sensor Networks or "smart" devices in the Internet of Things have to be resistant to a broad spectrum of physical attacks, for example to Side Channel Analysis and to Fault Injection attacks. In this work we concentrate on the vulnerability of ASICs to precise optical Fault Injection attacks. Here we propose to use metal fillers as potential low cost countermeasure that may be effective against a broad spectrum of physical attacks. In our future work we plan to evaluate different methods of metal fillers placement, to select an effective one and to integrate it as additional design rules into automated design flows.


Edge effect on the current temperature characteristic of thermionic cathodes. We perform a computational study, based on the molecular dynamics method, of the shape of Miram curves obtained from microscale planar diodes. We discuss the smooth transition from the source limited to space charge limited regime due to the finite size of the emitter, i.e. the "knee" in the Miram curve. In our model we find that the smoothing occurs mostly due to the increased emission at the external edges of the emitting area, and that the knee becomes softer when the size of the emitting area decreases. We relate this to the recent work which has described how a heterogeneous work function similarly affects the Miram curve.


Roadmap for label free imaging with microsphere superlens and metamaterial solid immersion lens. In 2011, super resolution imaging by microsphere superlens was emerged as a simple yet effective method to overcome the diffraction limit that limits the resolution of conventional lenses. Significant progress has since been made. Key advances including the development of scanning superlens system, metamaterial solid immersion lens (mSIL), super resolution physics and bio superlens will be discussed. Challenges and solutions are then discussed.


Unsupervised Part Discovery from Contrastive Reconstruction. The goal of self supervised visual representation learning is to learn strong, transferable image representations, with the majority of research focusing on object or scene level. On the other hand, representation learning at part level has received significantly less attention. In this paper, we propose an unsupervised approach to object part discovery and segmentation and make three contributions. First, we construct a proxy task through a set of objectives that encourages the model to learn a meaningful decomposition of the image into its parts. Secondly, prior work argues for reconstructing or clustering pre computed features as a proxy to parts we show empirically that this alone is unlikely to find meaningful parts mainly because of their low resolution and the tendency of classification networks to spatially smear out information. We suggest that image reconstruction at the level of pixels can alleviate this problem, acting as a complementary cue. Lastly, we show that the standard evaluation based on keypoint regression does not correlate well with segmentation quality and thus introduce different metrics, NMI and ARI, that better characterize the decomposition of objects into parts. Our method yields semantic parts which are consistent across fine grained but visually distinct categories, outperforming the state of the art on three benchmark datasets. Code is available at the project page https www.robots.ox.ac.uk vgg research unsup parts .


Self Supervised Monocular Depth Estimation of Untextured Indoor Rotated Scenes. Self supervised deep learning methods have leveraged stereo images for training monocular depth estimation. Although these methods show strong results on outdoor datasets such as KITTI, they do not match performance of supervised methods on indoor environments with camera rotation. Indoor, rotated scenes are common for less constrained applications and pose problems for two reasons abundance of low texture regions and increased complexity of depth cues for images under rotation. In an effort to extend self supervised learning to more generalised environments we propose two additions. First, we propose a novel Filled Disparity Loss term that corrects for ambiguity of image reconstruction error loss in textureless regions. Specifically, we interpolate disparity in untextured regions, using the estimated disparity from surrounding textured areas, and use L1 loss to correct the original estimation. Our experiments show that depth estimation is substantially improved on low texture scenes, without any loss on textured scenes, when compared to Monodepth by Godard et al. Secondly, we show that training with an application's representative rotations, in both pitch and roll, is sufficient to significantly improve performance over the entire range of expected rotation. We demonstrate that depth estimation is successfully generalised as performance is not lost when evaluated on test sets with no camera rotation. Together these developments enable a broader use of self supervised learning of monocular depth estimation for complex environments.


Modeling and experimental research of the processes of radiation damage formation in the interaction of gamma quanta flows and relativistic electron beams with solution of organic dyes. The processes of interaction of an aqueous solution of methylene blue (MB) organic dye ( C 16 H 18 N 3 SCl ) with gamma quanta and electrons have been investigated. A model has been developed, and the passage of electrons with an energy of 15 MeV through tungsten layers with a thickness of 1...8 mm has been simulated. A number of experiments were carried out on the basis of the simulation results. Analysis of the calculated and experimental data showed that one incident electron destroys 4 times more dye molecules than one incident gamma quantum.


Optimization of optical waveguide antennas for directive emission of light. Optical travelling wave antennas offer unique opportunities to control and selectively guide light into a specific direction which renders them as excellent candidates for optical communication and sensing. These applications require state of the art engineering to reach optimized functionalities such as high directivity and radiation efficiency, low side lobe level, broadband and tunable capabilities, and compact design. In this work we report on the numerical optimization of the directivity of optical travelling wave antennas made from low loss dielectric materials using full wave numerical simulations in conjunction with a particle swarm optimization algorithm. The antennas are composed of a reflector and a director deposited on a glass substrate and an emitter placed in the feed gap between them serves as an internal source of excitation. In particular, we analysed antennas with rectangular and horn shaped directors made of either Hafnium dioxide or Silicon. The optimized antennas produce highly directional emission due to the presence of two dominant guided TE modes in the director in addition to leaky modes. These guided modes dominate the far field emission pattern and govern the direction of the main lobe emission which predominately originates from the end facet of the director. Our work also provides a comprehensive analysis of the modes, radiation patterns, parametric influences, and bandwidths of the antennas that highlights their robust nature.


Ontology Assisted Generalisation of Robot Action Execution Knowledge. When an autonomous robot learns how to execute actions, it is of interest to know if and when the execution policy can be generalised to variations of the learning scenarios. This can inform the robot about the necessity of additional learning, as using incomplete or unsuitable policies can lead to execution failures. Generalisation is particularly relevant when a robot has to deal with a large variety of objects and in different contexts. In this paper, we propose and analyse a strategy for generalising parameterised execution models of manipulation actions over different objects based on an object ontology. In particular, a robot transfers a known execution model to objects of related classes according to the ontology, but only if there is no other evidence that the model may be unsuitable. This allows using ontological knowledge as prior information that is then refined by the robot's own experiences. We verify our algorithm for two actions grasping and stowing everyday objects such that we show that the robot can deduce cases in which an existing policy can generalise to other objects and when additional execution knowledge has to be acquired.


Mining and Classifying Privacy and Data Protection Requirements in Issue Reports. Digital and physical footprints are a trail of user activities collected over the use of software applications and systems. As software becomes ubiquitous, protecting user privacy has become challenging. With the increase of user privacy awareness and advent of privacy regulations and policies, there is an emerging need to implement software systems that enhance the protection of personal data processing. However, existing data protection and privacy regulations provide key principles in high level, making it difficult for software engineers to design and implement privacy aware systems. In this paper, we develop a taxonomy that provides a comprehensive set of privacy requirements based on four well established personal data protection regulations and privacy frameworks, the General Data Protection Regulation (GDPR), ISO IEC 29100, Thailand Personal Data Protection Act (Thailand PDPA) and Asia Pacific Economic Cooperation (APEC) privacy framework. These requirements are extracted, refined and classified into a level that can be used to map with issue reports. We have also performed a study on how two large open source software projects (Google Chrome and Moodle) address the privacy requirements in our taxonomy through mining their issue reports. The paper discusses how the collected issues were classified, and presents the findings and insights generated from our study. Mining and classifying privacy requirements in issue reports can help organisations be aware of their state of compliance by identifying privacy requirements that have not been addressed in their software projects. The taxonomy can also trace back to regulations, standards and frameworks that the software projects have not complied with based on the identified privacy requirements.


Iris Recognition Based on SIFT Features. Biometric methods based on iris images are believed to allow very high accuracy, and there has been an explosion of interest in iris biometrics in recent years. In this paper, we use the Scale Invariant Feature Transformation (SIFT) for recognition using iris images. Contrarily to traditional iris recognition systems, the SIFT approach does not rely on the transformation of the iris pattern to polar coordinates or on highly accurate segmentation, allowing less constrained image acquisition conditions. We extract characteristic SIFT feature points in scale space and perform matching based on the texture information around the feature points using the SIFT operator. Experiments are done using the BioSec multimodal database, which includes 3,200 iris images from 200 individuals acquired in two different sessions. We contribute with the analysis of the influence of different SIFT parameters on the recognition performance. We also show the complementarity between the SIFT approach and a popular matching approach based on transformation to polar coordinates and Log Gabor wavelets. The combination of the two approaches achieves significantly better performance than either of the individual schemes, with a performance improvement of 24 in the Equal Error Rate.


Learning stochastic dynamical systems with neural networks mimicking the Euler Maruyama scheme. Stochastic differential equations (SDEs) are one of the most important representations of dynamical systems. They are notable for the ability to include a deterministic component of the system and a stochastic one to represent random unknown factors. However, this makes learning SDEs much more challenging than ordinary differential equations (ODEs). In this paper, we propose a data driven approach where parameters of the SDE are represented by a neural network with a built in SDE integration scheme. The loss function is based on a maximum likelihood criterion, under order one Markov Gaussian assumptions. The algorithm is applied to the geometric brownian motion and a stochastic version of the Lorenz 63 model. The latter is particularly hard to handle due to the presence of a stochastic component that depends on the state. The algorithm performance is attested using different simulations results. Besides, comparisons are performed with the reference gradient matching method used for non linear drift estimation, and a neural networks based method, that does not consider the stochastic term.


Size Matters in Univalent Foundations. We investigate predicative aspects of constructive univalent foundations. By predicative and constructive, we respectively mean that we do not assume Voevodsky's propositional resizing axioms or excluded middle. Our work complements existing work on predicative mathematics by exploring what cannot be done predicatively in univalent foundations. Our first main result is that nontrivial (directed or bounded) complete posets are necessarily large. That is, if such a nontrivial poset is small, then weak propositional resizing holds. It is possible to derive full propositional resizing if we strengthen nontriviality to positivity. The distinction between nontriviality and positivity is analogous to the distinction between nonemptiness and inhabitedness. Moreover, we prove that locally small, nontrivial (directed or bounded) complete posets necessarily lack decidable equality. We prove our results for a general class of posets, which includes directed complete posets, bounded complete posets and sup lattices. Secondly, we show that each of Zorn's lemma, Tarski's greatest fixed point theorem and Pataraia's lemma implies propositional resizing. Hence, these principles are inherently impredicative and a predicative development of order theory must therefore do without them. Thirdly, we clarify, in our predicative setting, the relation between the traditional definition of sup lattice that requires suprema for all subsets and our definition that asks for suprema of all small families. Finally, we investigate the inter definability and interaction of type universes of propositional truncations and set quotients in the absence of propositional resizing axioms.


Standing Wave Solutions in Twisted Multicore Fibers. In the present work, we consider the existence and spectral stability of standing wave solutions to a model for light propagation in a twisted multi core fiber with no gain or loss of energy. Numerical parameter continuation experiments demonstrate the existence of standing wave solutions for sufficiently small values of the coupling parameter. Furthermore, standing waves exhibiting optical Aharonov Bohm suppression, where there is a single waveguide which remains unexcited, exist when the twist parameter phi and the number of waveguides N is related by phi pi N . Spectral computations and numerical timestepping simulations suggest that standing wave solutions where the energy is concentrated in a single site are neutrally stable. Solutions with asymmetric coupling and multi pulse solutions are also briefly explored.


A First Look at RISC V Virtualization from an Embedded Systems Perspective. This article describes the first public implementation and evaluation of the latest version of the RISC V hypervisor extension (H extension v0.6.1) specification in a Rocket chip core. To perform a meaningful evaluation for modern multi core embedded and mixedcriticality systems, we have ported Bao, an open source static partitioning hypervisor, to RISC V. We have also extended the RISC V platformlevel interrupt controller (PLIC) to enable direct guest interrupt injection with low and deterministic latency and we have enhanced the timer infrastructure to avoid trap and emulation overheads. Experiments were carried out in FireSim, a cycle accurate, FPGA accelerated simulator, and the system was also successfully deployed and tested in a Zynq UltraScale MPSoC ZCU104. Our hardware implementation was opensourced and is currently in use by the RISC V community towards the ratification of the H extension specification.


SkyCell A Space Pruning Based Parallel Skyline Algorithm. Skyline computation is an essential database operation that has many applications in multi criteria decision making scenarios such as recommender systems. Existing algorithms have focused on checking point domination, which lack efficiency over large datasets. We propose a grid based structure that enables grid cell domination checks. We show that only a small constant number of cells need to be checked which is independent from the number of data points. Our structure also enables parallel processing. We thus obtain a highly efficient parallel skyline algorithm named SkyCell, taking advantage of the parallelization power of graphics processing units. Experimental results confirm the effectiveness and efficiency of SkyCell it outperforms state of the art algorithms consistently and by up to over two orders of magnitude in the computation time.


PI GNN A Novel Perspective on Semi Supervised Node Classification against Noisy Labels. Semi supervised node classification, as a fundamental problem in graph learning, leverages unlabeled nodes along with a small portion of labeled nodes for training. Existing methods rely heavily on high quality labels, which, however, are expensive to obtain in real world applications since certain noises are inevitably involved during the labeling process. It hence poses an unavoidable challenge for the learning algorithm to generalize well. In this paper, we propose a novel robust learning objective dubbed pairwise interactions (PI) for the model, such as Graph Neural Network (GNN) to combat noisy labels. Unlike classic robust training approaches that operate on the pointwise interactions between node and class label pairs, PI explicitly forces the embeddings for node pairs that hold a positive PI label to be close to each other, which can be applied to both labeled and unlabeled nodes. We design several instantiations for PI labels based on the graph structure and the node class labels, and further propose a new uncertainty aware training technique to mitigate the negative effect of the sub optimal PI labels. Extensive experiments on different datasets and GNN architectures demonstrate the effectiveness of PI, yielding a promising improvement over the state of the art methods.


A 14 moment maximum entropy description of electrons in crossed electric and magnetic fields. A 14 moment maximum entropy system of equations is applied to the description of non equilibrium electrons in crossed electric and magnetic fields and in the presence of low collisionality, characteristic of low temperature plasma devices. The flexibility of this formulation is analyzed through comparison with analytical results for steady state non equilibrium velocity distribution functions and against particle based solutions of the time dependent kinetic equation. Electric and magnetic source terms are derived for the 14 moment equations, starting from kinetic theory. A simplified BGK like collision term is formulated to describe the collision of electrons with background neutrals, accounting for the large mass disparity and for energy exchange. An approximated expression is proposed for the collision frequency, to include the effect of the electrons drift velocity, showing good accuracy in the considered conditions. The capabilities of the proposed 14 moment closure to capture accurately non equilibrium behaviour of electrons for space homogeneous problems under conditions representative of those found in Hall thrusters is demonstrated.


Conservative Hybrid Automata from Development Artifacts. The verification of cyber physical systems operating in a safety critical environment requires formal system models. The validity of the verification hinges on the precision of the model possible behavior not captured in the model can result in formally verified, but unsafe systems. Yet, manual construction is delicate and error prone while automatic construction does not scale for large and complex systems. As a remedy, this paper devises an automatic construction algorithm that utilizes information contained in artifacts of the development process a runtime monitoring specification and recorded test traces. These artifacts incur no additional cost and provide sufficient information so that the construction process scales well for large systems. The algorithm uses a hybrid approach between a top down and a bottom up construction which allows for proving the result conservative, while limiting the level of over approximation.


Regularizing properties of the double layer potential of second order elliptic differential operators. We prove the validity of regularizing properties of a double layer potential associated to the fundamental solution of a em nonhomogeneous second order elliptic differential operator with constant coefficients in Schauder spaces by exploiting an explicit formula for the tangential derivatives of the double layer potential itself. We also introduce ad hoc norms for kernels of integral operators in order to prove continuity results of integral operators upon variation of the kernel, which we apply to layer potentials.


On the centre of crossed modules of groups and Lie algebras. Crossed modules are algebraic models of homotopy 2 types and hence have pi 1 and pi 2 . We propose a definition of the centre of a crossed module whose essential invariants can be computed via the group cohomology H i( pi 1, pi 2) . This definition therefore has much nicer properties than one proposed by Norrie in the 80s.


Stochastic Optimized Schwarz Methods for the Gravity Equations on Graphics Processing Unit. Low order, sequential or non massively parallel finite elements are generaly used for three dimensional gravity modelling. In this paper, in order to obtain better gravity anomaly solutions in heterogeneous media, we solve the gravimetry problem using massively parallel high order finite elements on hybrid multi CPU GPU clusters. Parallel algorithms well suited for such hybrid architectures have to be designed. A new stochastic based optimization procedure for the optimized Schwarz method is here presented, implemented and tuned to graphical cards processors units. Numerical experiments performed on a reallistic test case, demonstrates the robustness and efficiency of the proposed method and of its implementation on massive multi CPU GPU architectures.


Can the electric field in radiation damaged silicon pad diodes be determined by admittance and current measurements?. A method is proposed for determining the electric field in highly irradiated silicon pad diodes using admittance frequency (Y f ), and current measurements (I). The method is applied to Y f and I data from square n p diodes of 25mm2 area irradiated by 24 GeV c protons to four 1MeV neutron equivalent fluences between 3E15 cm 2 and 13E15 cm 2. The measurement conditions were Reverse voltages between 1V and 1000V, frequencies between 100Hz and 2MHz and temperatures of 20 deg C and 30 deg C. The position dependence of the electric field is parameterised by a linear dependence at the two sides of the diode, and a constant in the centre. The parameters as a function of voltage, temperature and irradiation fluence are determined by fits of the model to the data. For voltages below about 300V all data are well described by the model, and the results for the electric field agrees with expectations Depleted high field regions towards the two faces and a constant low electric field in the centre, with values which agrees with the field in an ohmic resistor with approximately the intrinsic resistivity of silicon. For conditions at which the low field region disappears and the diode is fully depleted, the method fails. This happens around 300V for the lowest irradiation fluence at 30 deg C, and at higher voltages for higher fluences and lower temperatures. In the conclusions the successes and problems of the method are discussed.


Smooth extensions for inertial manifolds of semilinear parabolic equations. The paper is devoted to a comprehensive study of smoothness of inertial manifolds for abstract semilinear parabolic problems. It is well known that in general we cannot expect more than C 1, varepsilon regularity for such manifolds (for some positive, but small varepsilon ). Nevertheless, as shown in the paper, under the natural assumptions, the obstacles to the existence of a C n smooth inertial manifold (where n in mathbb N is any given number) can be removed by increasing the dimension and by modifying properly the nonlinearity outside of the global attractor (or even outside the C 1, varepsilon smooth IM of a minimal dimension). The proof is strongly based on the Whitney extension theorem.


Astrocytes mediate analogous memory in a multi layer neuron astrocytic network. Modeling the neuronal processes underlying short term working memory remains the focus of many theoretical studies in neuroscience. Here we propose a mathematical model of spiking neuron network (SNN) demonstrating how a piece of information can be maintained as a robust activity pattern for several seconds then completely disappear if no other stimuli come. Such short term memory traces are preserved due to the activation of astrocytes accompanying the SNN. The astrocytes exhibit calcium transients at a time scale of seconds. These transients further modulate the efficiency of synaptic transmission and, hence, the firing rate of neighboring neurons at diverse timescales through gliotransmitter release. We show how such transients continuously encode frequencies of neuronal discharges and provide robust short term storage of analogous information. This kind of short term memory can keep operative information for seconds, then completely forget it to avoid overlapping with forthcoming patterns. The SNN is inter connected with the astrocytic layer by local inter cellular diffusive connections. The astrocytes are activated only when the neighboring neurons fire quite synchronously, e.g. when an information pattern is loaded. For illustration, we took greyscale photos of people's faces where the grey level encoded the level of applied current stimulating the neurons. The astrocyte feedback modulates (facilitates) synaptic transmission by varying the frequency of neuronal firing. We show how arbitrary patterns can be loaded, then stored for a certain interval of time, and retrieved if the appropriate clue pattern is applied to the input.


On Polytopes with Linear Rank with respect to Generalizations of the Split Closure. In this paper we study the rank of polytopes contained in the 0 1 cube with respect to t branch split cuts and t dimensional lattice cuts for a fixed positive integer t . These inequalities are the same as split cuts when t 1 and generalize split cuts when t 1 . For polytopes contained in the n dimensional 0 1 cube, the work of Balas implies that the split rank can be at most n , and this bound is tight as Cornu 'ejols and Li gave an example with split rank n . All known examples with high split rank i.e., at least cn for some positive constant c 1 are defined by exponentially many (as a function of n ) linear inequalities. For any fixed integer t 0 , we give a family of polytopes contained in 0,1 n for sufficiently large n such that each polytope has empty integer hull, is defined by O(n) inequalities, and has rank Omega(n) with respect to t dimensional lattice cuts. Therefore the split rank of these polytopes is Omega(n) . It was shown earlier that there exist generalized branch and bound proofs, with logarithmic depth, of the nonexistence of integer points in these polytopes. Therefore, our lower bound results on split rank show an exponential separation between the depth of branch and bound proofs and split rank.


Model reduction of convection dominated partial differential equations via optimization based implicit feature tracking. This work introduces a new approach to reduce the computational cost of solving partial differential equations (PDEs) with convection dominated solutions model reduction with implicit feature tracking. Traditional model reduction techniques use an affine subspace to reduce the dimensionality of the solution manifold and, as a result, yield limited reduction and require extensive training due to the slowly decaying Kolmogorov n width of convection dominated problems. The proposed approach circumvents the slowly decaying n width limitation by using a nonlinear approximation manifold systematically defined by composing a low dimensional affine space with a space of bijections of the underlying domain. Central to the implicit feature tracking approach is a residual minimization problem over the reduced nonlinear manifold that simultaneously determines the reduced coordinates in the affine space and the domain mapping that minimize the residual of the unreduced PDE discretization. The nonlinear trial manifold is constructed by using the proposed residual minimization formulation to determine domain mappings that cause parametrized features to align in a reference domain for a set of training parameters. Because the feature is stationary in the reference domain, i.e., the convective nature of solution removed, the snapshots are effectively compressed to define an affine subspace. The space of domain mappings, originally constructed using high order finite elements, are also compressed in a way that ensures the boundaries of the original domain are maintained. Several numerical experiments are provided, including transonic and supersonic, inviscid, compressible flows, to demonstrate the potential of the method to yield accurate approximations to convection dominated problems with limited training.


An Efficient Diagnosis Algorithm for Inconsistent Constraint Sets. Constraint sets can become inconsistent in different contexts. For example, during a configuration session the set of customer requirements can become inconsistent with the configuration knowledge base. Another example is the engineering phase of a configuration knowledge base where the underlying constraints can become inconsistent with a set of test cases. In such situations we are in the need of techniques that support the identification of minimal sets of faulty constraints that have to be deleted in order to restore consistency. In this paper we introduce a divide and conquer based diagnosis algorithm (FastDiag) which identifies minimal sets of faulty constraints in an over constrained problem. This algorithm is specifically applicable in scenarios where the efficient identification of leading (preferred) diagnoses is crucial. We compare the performance of FastDiag with the conflict directed calculation of hitting sets and present an in depth performance analysis that shows the advantages of our approach.


Rate Allocation and Content Placement in Cache Networks. We introduce the problem of optimal congestion control in cache networks, whereby emph both rate allocations and content placements are optimized emph jointly . We formulate this as a maximization problem with non convex constraints, and propose solving this problem via (a) a Lagrangian barrier algorithm and (b) a convex relaxation. We prove different optimality guarantees for each of these two algorithms our proofs exploit the fact that the non convex constraints of our problem involve DR submodular functions.


Reinforcement Learning based Dynamic Service Placement in Vehicular Networks. The emergence of technologies such as 5G and mobile edge computing has enabled provisioning of different types of services with different resource and service requirements to the vehicles in a vehicular network.The growing complexity of traffic mobility patterns and dynamics in the requests for different types of services has made service placement a challenging task. A typical static placement solution is not effective as it does not consider the traffic mobility and service dynamics. In this paper, we propose a reinforcement learning based dynamic (RL Dynamic) service placement framework to find the optimal placement of services at the edge servers while considering the vehicle's mobility and dynamics in the requests for different types of services. We use SUMO and MATLAB to carry out simulation experiments. In our learning framework, for the decision module, we consider two alternative objective functions minimizing delay and minimizing edge server utilization. We developed an ILP based problem formulation for the two objective functions. The experimental results show that 1) compared to static service placement, RL based dynamic service placement achieves fair utilization of edge server resources and low service delay, and 2) compared to delay optimized placement, server utilization optimized placement utilizes resources more effectively, achieving higher fairness with lower edge server utilization.


Multi Cell, Multi Channel Scheduling with Probabilistic Per Packet Real Time Guarantee. For mission critical sensing and control as well as Extended Reality (XR) applications such as those to be enabled by 5G Ultra Reliable, Low Latency Communications (URLLC), it is critical to ensure the communication quality of individual packets. Prior studies have considered Probabilistic Per packet Real time Communications (PPRC) guarantees for single cell, single channel networks with implicit deadline constraints, but they have not considered real world complexities such as inter cell interference and multiple communication channels. Towards ensuring PPRC in multi cell, multi channel wireless networks, we propose a real time scheduling algorithm based on emph local deadline partition (LDP) . The LDP algorithm is suitable for distributed implementation, and it ensures probabilistic per packet real time guarantee for multi cell, multi channel networks with general deadline constraints. We also address the associated challenge of the schedulability test of PPRC traffic. In particular, we propose the concept of emph feasible set and identify a closed form sufficient condition for the schedulability of PPRC traffic. We propose a distributed algorithm for the schedulability test, and the algorithm includes a procedure for finding the minimum sum work density of feasible sets which is of interest by itself. We also identify a necessary condition for the schedulability of PPRC traffic, and use numerical studies to understand a lower bound on the approximation ratio of the LDP algorithm. We experimentally study the properties of the LDP algorithm and observe that the PPRC traffic supportable by the LDP algorithm is significantly higher than that of a state of the art algorithm.


A semi supervised self training method to develop assistive intelligence for segmenting multiclass bridge elements from inspection videos. Bridge inspection is an important step in preserving and rehabilitating transportation infrastructure for extending their service lives. The advancement of mobile robotic technology allows the rapid collection of a large amount of inspection video data. However, the data are mainly images of complex scenes, wherein a bridge of various structural elements mix with a cluttered background. Assisting bridge inspectors in extracting structural elements of bridges from the big complex video data, and sorting them out by classes, will prepare inspectors for the element wise inspection to determine the condition of bridges. This paper is motivated to develop an assistive intelligence model for segmenting multiclass bridge elements from inspection videos captured by an aerial inspection platform. With a small initial training dataset labeled by inspectors, a Mask Region based Convolutional Neural Network (Mask R CNN) pre trained on a large public dataset was transferred to the new task of multiclass bridge element segmentation. Besides, the temporal coherence analysis attempts to recover false negatives and identify the weakness that the neural network can learn to improve. Furthermore, a semi supervised self training (S 3 T) method was developed to engage experienced inspectors in refining the network iteratively. Quantitative and qualitative results from evaluating the developed deep neural network demonstrate that the proposed method can utilize a small amount of time and guidance from experienced inspectors (3.58 hours for labeling 66 images) to build the network of excellent performance (91.8 precision, 93.6 recall, and 92.7 f1 score). Importantly, the paper illustrates an approach to leveraging the domain knowledge and experiences of bridge professionals into computational intelligence models to efficiently adapt the models to varied bridges in the National Bridge Inventory.


EFENet Reference based Video Super Resolution with Enhanced Flow Estimation. In this paper, we consider the problem of reference based video super resolution(RefVSR), i.e., how to utilize a high resolution (HR) reference frame to super resolve a low resolution (LR) video sequence. The existing approaches to RefVSR essentially attempt to align the reference and the input sequence, in the presence of resolution gap and long temporal range. However, they either ignore temporal structure within the input sequence, or suffer accumulative alignment errors. To address these issues, we propose EFENet to exploit simultaneously the visual cues contained in the HR reference and the temporal information contained in the LR sequence. EFENet first globally estimates cross scale flow between the reference and each LR frame. Then our novel flow refinement module of EFENet refines the flow regarding the furthest frame using all the estimated flows, which leverages the global temporal information within the sequence and therefore effectively reduces the alignment errors. We provide comprehensive evaluations to validate the strengths of our approach, and to demonstrate that the proposed framework outperforms the state of the art methods. Code is available at https github.com IndigoPurple EFENet.


Learning Optimal Predictive Checklists. Checklists are simple decision aids that are often used to promote safety and reliability in clinical applications. In this paper, we present a method to learn checklists for clinical decision support. We represent predictive checklists as discrete linear classifiers with binary features and unit weights. We then learn globally optimal predictive checklists from data by solving an integer programming problem. Our method allows users to customize checklists to obey complex constraints, including constraints to enforce group fairness and to binarize real valued features at training time. In addition, it pairs models with an optimality gap that can inform model development and determine the feasibility of learning sufficiently accurate checklists on a given dataset. We pair our method with specialized techniques that speed up its ability to train a predictive checklist that performs well and has a small optimality gap. We benchmark the performance of our method on seven clinical classification problems, and demonstrate its practical benefits by training a short form checklist for PTSD screening. Our results show that our method can fit simple predictive checklists that perform well and that can easily be customized to obey a rich class of custom constraints.


SLIP Walking over Rough Terrain via H LIP Stepping and Backstepping Barrier Function Inspired Quadratic Program. We present an advanced and novel control method to enable actuated Spring Loaded Inverted Pendulum model to walk over rough and challenging terrains. The high level philosophy is the decoupling of the controls of the vertical and horizontal states. The vertical state is controlled via Backstepping Barrier Function (BBF) based quadratic programs a combination of control Lyapunov backstepping and control barrier function, both of which provide inequality constraints on the inputs. The horizontal state is stabilized via Hybrid Linear Inverted Pendulum (H LIP) based stepping, which has a closed form formulation. Therefore, the implementation is computationally efficient. We evaluate our method in simulation, which demonstrates the aSLIP walking over various terrains, including slopes, stairs, and general rough terrains with uncertainties.


Maximally Recoverable Codes with Hierarchical Locality Constructions and Field Size Bounds. Maximally recoverable codes are a class of codes which recover from all potentially recoverable erasure patterns given the locality constraints of the code. In earlier works, these codes have been studied in the context of codes with locality. The notion of locality has been extended to hierarchical locality, which allows for locality to gradually increase in levels with the increase in the number of erasures. We consider the locality constraints imposed by codes with two level hierarchical locality and define maximally recoverable codes with data local and local hierarchical locality. We derive certain properties related to their punctured codes and minimum distance. We give a procedure to construct hierarchical data local MRCs from hierarchical local MRCs. We provide a construction of hierarchical local MRCs for all parameters. We also give constructions of MRC with hierarchical locality for some parameters, whose field size is smaller than that of known constructions for general parameters. We also derive a field size lower bound on MRC with hierarchical locality.


Similarity Aware Skill Reproduction based on Multi Representational Learning from Demonstration. Learning from Demonstration (LfD) algorithms enable humans to teach new skills to robots through demonstrations. The learned skills can be robustly reproduced from the identical or near boundary conditions (e.g., initial point). However, when generalizing a learned skill over boundary conditions with higher variance, the similarity of the reproductions changes from one boundary condition to another, and a single LfD representation cannot preserve a consistent similarity across a generalization region. We propose a novel similarity aware framework including multiple LfD representations and a similarity metric that can improve skill generalization by finding reproductions with the highest similarity values for a given boundary condition. Given a demonstration of the skill, our framework constructs a similarity region around a point of interest (e.g., initial point) by evaluating individual LfD representations using the similarity metric. Any point within this volume corresponds to a representation that reproduces the skill with the greatest similarity. We validate our multi representational framework in three simulated and four sets of real world experiments using a physical 6 DOF robot. We also evaluate 11 different similarity metrics and categorize them according to their biases in 286 simulated experiments.


QSSA An SSA based IR for Quantum Computing. Quantum computing hardware has progressed rapidly. Simultaneously, there has been a proliferation of programming languages and program optimization tools for quantum computing. Existing quantum compilers use intermediate representations (IRs) where quantum programs are described as circuits. Such IRs fail to leverage existing work on compiler optimizations. In such IRs, it is non trivial to statically check for physical constraints such as the no cloning theorem, which states that qubits cannot be copied. We introduce QSSA, a novel quantum IR based on static single assignment (SSA) that enables decades of research in compiler optimizations to be applied to quantum compilation. QSSA models quantum operations as being side effect free. The inputs and outputs of the operation are in one to one correspondence qubits cannot be created or destroyed. As a result, our IR supports a static analysis pass that verifies no cloning at compile time. The quantum circuit is fully encoded within the def use chain of the IR, allowing us to leverage existing optimization passes on SSA representations such as redundancy elimination and dead code elimination. Running our QSSA based compiler on the QASMBench and IBM Quantum Challenge datasets, we show that our optimizations perform comparably to IBM's Qiskit quantum compiler infrastructure. QSSA allows us to represent, analyze, and transform quantum programs using the robust theory of SSA representations, bringing quantum compilation into the realm of well understood theory and practice.


SpecBox A Label Based Transparent Speculation Scheme Against Transient Execution Attacks. Speculative execution techniques have been a cornerstone of modern processors to improve instruction level parallelism. However, recent studies showed that this kind of techniques could be exploited by attackers to leak secret data via transient execution attacks, such as Spectre. Many defenses are proposed to address this problem, but they all face various challenges (1) Tracking data flow in the instruction pipeline could comprehensively address this problem, but it could cause pipeline stalls and incur high performance overhead (2) Making side effect of speculative execution imperceptible to attackers, but it often needs additional storage components and complicated data movement operations. In this paper, we propose a label based transparent speculation scheme called SpecBox. It dynamically partitions the cache system to isolate speculative data and non speculative data, which can prevent transient execution from being observed by subsequent execution. Moreover, it uses thread ownership semaphores to prevent speculative data from being accessed across cores. In addition, SpecBox also enhances the auxiliary components in the cache system against transient execution attacks, such as hardware prefetcher. Our security analysis shows that SpecBox is secure and the performance evaluation shows that the performance overhead on SPEC CPU 2006 and PARSEC 3.0 benchmarks is small.


A method to coarse grain multi agent stochastic systems with regions of multistability. Hybrid multiscale modelling has emerged as a useful framework for modelling complex biological phenomena. However, when accounting for stochasticity in the internal dynamics of agents, these models frequently become computationally expensive. Traditional techniques to reduce the computational intensity of such models can lead to a reduction in the richness of the dynamics observed, compared to the original system. Here we use large deviation theory to decrease the computational cost of a spatially extended multi agent stochastic system with a region of multi stability by coarse graining it to a continuous time Markov chain on the state space of stable steady states of the original system. Our technique preserves the original description of the stable steady states of the system and accounts for noise induced transitions between them. We apply the method to a bistable system modelling phenotype specification of cells driven by a lateral inhibition mechanism. For this system, we demonstrate how the method may be used to explore different pattern configurations and unveil robust patterns emerging on longer timescales. We then compare the full stochastic, coarse grained and mean field descriptions via pattern quantification metrics and in terms of the numerical cost of each method. Our results show that the coarse grained system exhibits the lowest computational cost while preserving the rich dynamics of the stochastic system. The method has the potential to reduce the computational complexity of hybrid multiscale models, making them more tractable for analysis, simulation and hypothesis testing.


Predicting Users' Value Changes by the Friends' Influence from Social Media Usage. Basic human values represent a set of values such as security, independence, success, kindness, and pleasure, which we deem important to our lives. Each of us holds different values with different degrees of significance. Existing studies show that values of a person can be identified from their social network usage. However, the value priority of a person may change over time due to different factors such as life experiences, influence, social structure and technology. Existing studies do not conduct any analysis regarding the change of users' value from the social influence, i.e., group persuasion, form the social media usage. In our research, first, we predict users' value score by the influence of friends from their social media usage. We propose a Bounded Confidence Model (BCM) based value dynamics model from 275 different ego networks in Facebook that predicts how social influence may persuade a person to change their value over time. Then, to predict better, we use particle swarm optimization based hyperparameter tuning technique. We observe that these optimized hyperparameters produce accurate future value score. We also run our approach with different machine learning based methods and find support vector regression (SVR) outperforms other regressor models. By using SVR with the best hyperparameters of BCM model, we find the lowest Mean Squared Error (MSE) score 0.00347.


Freezing Sub Models During Incremental Process Discovery Extended Version. Process discovery aims to learn a process model from observed process behavior. From a user's perspective, most discovery algorithms work like a black box. Besides parameter tuning, there is no interaction between the user and the algorithm. Interactive process discovery allows the user to exploit domain knowledge and to guide the discovery process. Previously, an incremental discovery approach has been introduced where a model, considered to be under construction, gets incrementally extended by user selected process behavior. This paper introduces a novel approach that additionally allows the user to freeze model parts within the model under construction. Frozen sub models are not altered by the incremental approach when new behavior is added to the model. The user can thus steer the discovery algorithm. Our experiments show that freezing sub models can lead to higher quality models.


DMInet An Accurate and Highly Flexible Deep Learning Framework for Drug Membrane Interaction with Membrane Selectivity. Drug membrane interaction is a very significant bioprocess to consider in drug discovery. Here, we propose a novel deep learning framework coined DMInet to study drug membrane interactions that leverages large scale Martini coarse grained molecular simulations of permeation of drug like molecules across six different lipid membranes. The network of DMInet receives three inputs, viz, the drug like molecule, membrane type, and spatial distance across membrane thickness, and predicts the potential of mean force with structural resolution across the lipid membrane and membrane selectivity. Inheriting from coarse grained Martini representation of organic molecules and combined with deep learning, DMInet has the potential for more accelerated high throughput screening in drug discovery across a much larger chemical space than that can be explored by physics based simulations alone. Moreover, DMInet is highly flexible in its nature and holds the possibilities for other properties prediction without significant changes in the architecture. Last but not least, the architecture of DMInet is general and can be applied to other membrane problems involving permeation and selection.


Learning Representations for Pixel based Control What Matters and Why?. Learning representations for pixel based control has garnered significant attention recently in reinforcement learning. A wide range of methods have been proposed to enable efficient learning, leading to sample complexities similar to those in the full state setting. However, moving beyond carefully curated pixel data sets (centered crop, appropriate lighting, clear background, etc.) remains challenging. In this paper, we adopt a more difficult setting, incorporating background distractors, as a first step towards addressing this challenge. We present a simple baseline approach that can learn meaningful representations with no metric based learning, no data augmentations, no world model learning, and no contrastive learning. We then analyze when and why previously proposed methods are likely to fail or reduce to the same performance as the baseline in this harder setting and why we should think carefully about extending such methods beyond the well curated environments. Our results show that finer categorization of benchmarks on the basis of characteristics like density of reward, planning horizon of the problem, presence of task irrelevant components, etc., is crucial in evaluating algorithms. Based on these observations, we propose different metrics to consider when evaluating an algorithm on benchmark tasks. We hope such a data centric view can motivate researchers to rethink representation learning when investigating how to best apply RL to real world tasks.


PICASO Permutation Invariant Cascaded Attentional Set Operator. Set input deep networks have recently drawn much interest in computer vision and machine learning. This is in part due to the increasing number of important tasks such as meta learning, clustering, and anomaly detection that are defined on set inputs. These networks must take an arbitrary number of input samples and produce the output invariant to the input set permutation. Several algorithms have been recently developed to address this urgent need. Our paper analyzes these algorithms using both synthetic and real world datasets, and shows that they are not effective in dealing with common data variations such as image translation or viewpoint change. To address this limitation, we propose a permutation invariant cascaded attentional set operator (PICASO). The gist of PICASO is a cascade of multihead attention blocks with dynamic templates. The proposed operator is a stand alone module that can be adapted and extended to serve different machine learning tasks. We demonstrate the utilities of PICASO in four diverse scenarios (i) clustering, (ii) image classification under novel viewpoints, (iii) image anomaly detection, and (iv) state prediction. PICASO increases the SmallNORB image classification accuracy with novel viewpoints by about 10 points. For set anomaly detection on CelebA dataset, our model improves the areas under ROC and PR curves dataset by about 22 and 10 , respectively. For the state prediction on CLEVR dataset, it improves the AP by about 40 .


Composition operators on Hardy Sobolev spaces with bounded reproducing kernels. For any real beta let H 2 beta be the Hardy Sobolev space on the unit disc mathbb D . H 2 beta is a reproducing kernel Hilbert space and its reproducing kernel is bounded when beta 1 2 . In this paper, we characterize that for a non constant analytic function varphi mathbb D to mathbb D , when the composition operator C varphi on H 2 beta is Fredholm. For 1 2 beta 1 , we also prove that C varphi has dense range in H beta 2 if and only if the polynomials are dense in a certain Dirichlet space of the domain varphi( mathbb D ) . It follows that if the range of C varphi is dense in H beta 2 , then varphi is a weak star generator of H infty , although the conclusion is false for the classical Dirichlet space mathfrak D . Moreover, we study the relation between the density of the rang of C varphi and the cyclic vector of the multiplier M varphi beta .


A note on fully commutative elements in complex reflection groups. Fully commutative elements in types B and D are completely characterized and counted by Stembridge. Recently, Feinberg Kim Lee Oh have extended the study of fully commutative elements from Coxeter groups to the complex setting, giving an enumeration of such elements in G(m,1,n) . In this note, we prove a connection between fully commutative elements in B n and in G(m,1,n) , which allows us to characterize fully commutative elements in G(m,1,n ) by pattern avoidance. Further, we present a counting formula for such elements in G(m,1,n) .


Topological Detection of Trojaned Neural Networks. Deep neural networks are known to have security issues. One particular threat is the Trojan attack. It occurs when the attackers stealthily manipulate the model's behavior through Trojaned training samples, which can later be exploited. Guided by basic neuroscientific principles we discover subtle yet critical structural deviation characterizing Trojaned models. In our analysis we use topological tools. They allow us to model high order dependencies in the networks, robustly compare different networks, and localize structural abnormalities. One interesting observation is that Trojaned models develop short cuts from input to output layers. Inspired by these observations, we devise a strategy for robust detection of Trojaned models. Compared to standard baselines it displays better performance on multiple benchmarks.


Information Bottleneck for an Oblivious Relay with Channel State Information the Vector Case. This paper considers the information bottleneck (IB) problem of a Rayleigh fading multiple input multiple out (MIMO) channel. Due to the bottleneck constraint, it is impossible for the oblivious relay to inform the destination node of the perfect channel state information (CSI) in each channel realization. To evaluate the bottleneck rate, we provide an upper bound by assuming that the destination node can get the perfect CSI at no cost and two achievable schemes with simple symbol by symbol relay processing and compression. Numerical results show that the lower bounds obtained by the proposed achievable schemes can come close to the upper bound on a wide range of relevant system parameters.


PGD based advanced nonlinear multiparametric regressions for constructing metamodels at the scarce data limit. Regressions created from experimental or simulated data enable the construction of metamodels, widely used in a variety of engineering applications. Many engineering problems involve multi parametric physics whose corresponding multi parametric solutions can be viewed as a sort of computational vademecum that, once computed offline, can be then used in a variety of real time engineering applications including optimization, inverse analysis, uncertainty propagation or simulation based control. Sometimes, these multi parametric problems can be solved by using advanced model order reduction MOR techniques. However, when the solution of these multi parametric problems becomes cumbersome, one possibility consists in solving the problem for a sample of the parametric values, and then creating a regression from all the computed solutions, to finally infer the solution for any choice of the problem parameters. However, addressing high dimensionality at the low data limit, ensuring accuracy and avoiding overfitting constitutes a difficult challenge. The present paper aims at proposing and discussing different PGD based advanced regressions enabling the just referred features.


Feedback equivalence and uniform ensemble reachability. This paper considers feedback methods for ensemble reachability of parameter dependent linear systems (A( theta),B( theta)) , where the parameter theta is varying over a compact Jordan arc in the complex plane. Recently, pointwise testable sufficient conditions for uniform ensemble reachability have been developed. Beside the necessity of pointwise reachablility these conditions put restrictions on the spectra of the matrices A( theta) and the Hermite indices of the pair (A( theta),B( theta)) . In this paper we show that these conditions can be ensured by applying a suitable feedback transformation if the pair (A( theta),B( theta)) is pointwise reachable and it Kronecker indices are independent from the parameter.


Restricted Gr "obner fans and good re embeddings. In this paper we continue the study of good re embeddings of affine K algebras started in KLR . The idea is to use special linear projections to find isomorphisms between a given affine K algebra K X I, where X (x 1,...,x n), and K algebras having fewer generators. These projections are induced by particular tuples of indeterminates Z and by term orderings sigma which realize Z as leading terms of a tuple F of polynomials in I. In order to efficiently find such tuples, we provide two major new tools an algorithm which reduces the check whether a given tuple F is Z separating to an LP feasibility problem, and an isomorphism between the part of the Gr "obner fan of I consisting of marked reduced Gr "obner bases which contain a Z separating tuple and the Gr "obner fan of the intersection of I and K X Z . We also indicate a possible generalization to tuples Z which consist of terms. All results are illustrated by explicit examples.


PyTorchVideo A Deep Learning Library for Video Understanding. We introduce PyTorchVideo, an open source deep learning library that provides a rich set of modular, efficient, and reproducible components for a variety of video understanding tasks, including classification, detection, self supervised learning, and low level processing. The library covers a full stack of video understanding tools including multimodal data loading, transformations, and models that reproduce state of the art performance. PyTorchVideo further supports hardware acceleration that enables real time inference on mobile devices. The library is based on PyTorch and can be used by any training framework for example, PyTorchLightning, PySlowFast, or Classy Vision. PyTorchVideo is available at https pytorchvideo.org


An ASIC Implementation and Evaluation of a Profiled Low Energy Instruction Set Architecture Extension. This paper presents an extension to an existing instruction set architecture, which gains considerable reduction in power consumption. The reduction in power consumption is achieved through coding of the most commonly executed instructions in a short format done by the compiler based on a profile of previous executions. This leads to fewer accesses to the instruction cache and that more instructions can fit in the cache. As a secondary effect, this turned out to be very beneficial in terms of power. Another major advantage, which is the main concern of this paper is the reduction in the number of instruction fetch cycles which will also contribute significantly towards reduction in power consumption. The work involves implementing the new processor architecture in ASIC and estimation of power consumption compared to the normal architecture.


Streaming Social Event Detection and Evolution Discovery in Heterogeneous Information Networks. Events are happening in real world and real time, which can be planned and organized for occasions, such as social gatherings, festival celebrations, influential meetings or sports activities. Social media platforms generate a lot of real time text information regarding public events with different topics. However, mining social events is challenging because events typically exhibit heterogeneous texture and metadata are often ambiguous. In this paper, we first design a novel event based meta schema to characterize the semantic relatedness of social events and then build an event based heterogeneous information network (HIN) integrating information from external knowledge base. Second, we propose a novel Pairwise Popularity Graph Convolutional Network, named as PP GCN, based on weighted meta path instance similarity and textual semantic representation as inputs, to perform fine grained social event categorization and learn the optimal weights of meta paths in different tasks. Third, we propose a streaming social event detection and evolution discovery framework for HINs based on meta path similarity search, historical information about meta paths, and heterogeneous DBSCAN clustering method. Comprehensive experiments on real world streaming social text data are conducted to compare various social event detection and evolution discovery algorithms. Experimental results demonstrate that our proposed framework outperforms other alternative social event detection and evolution discovery techniques.


A Comparative Review of Recent Few Shot Object Detection Algorithms. Few shot object detection, learning to adapt to the novel classes with a few labeled data, is an imperative and long lasting problem due to the inherent long tail distribution of real world data and the urgent demands to cut costs of data collection and annotation. Recently, some studies have explored how to use implicit cues in extra datasets without target domain supervision to help few shot detectors refine robust task notions. This survey provides a comprehensive overview from current classic and latest achievements for few shot object detection to future research expectations from manifold perspectives. In particular, we first propose a data based taxonomy of the training data and the form of corresponding supervision which are accessed during the training stage. Following this taxonomy, we present a significant review of the formal definition, main challenges, benchmark datasets, evaluation metrics, and learning strategies. In addition, we present a detailed investigation of how to interplay the object detection methods to develop this issue systematically. Finally, we conclude with the current status of few shot object detection, along with potential research directions for this field.


Spiking Neural Networks with Improved Inherent Recurrence Dynamics for Sequential Learning. Spiking neural networks (SNNs) with leaky integrate and fire (LIF) neurons, can be operated in an event driven manner and have internal states to retain information over time, providing opportunities for energy efficient neuromorphic computing, especially on edge devices. Note, however, many representative works on SNNs do not fully demonstrate the usefulness of their inherent recurrence (membrane potentials retaining information about the past) for sequential learning. Most of the works train SNNs to recognize static images by artificially expanded input representation in time through rate coding. We show that SNNs can be trained for sequential tasks and propose modifications to a network of LIF neurons that enable internal states to learn long sequences and make their inherent recurrence resilient to the vanishing gradient problem. We then develop a training scheme to train the proposed SNNs with improved inherent recurrence dynamics. Our training scheme allows spiking neurons to produce multi bit outputs (as opposed to binary spikes) which help mitigate the mismatch between a derivative of spiking neurons' activation function and a surrogate derivative used to overcome spiking neurons' non differentiability. Our experimental results indicate that the proposed SNN architecture on TIMIT and LibriSpeech 100h dataset yields accuracy comparable to that of LSTMs (within 1.10 and 0.36 , respectively), but with 2x fewer parameters than LSTMs. The sparse SNN outputs also lead to 10.13x and 11.14x savings in multiplication operations compared to GRUs, which is generally con sidered as a lightweight alternative to LSTMs, on TIMIT and LibriSpeech 100h datasets, respectively.


The Use of Bandit Algorithms in Intelligent Interactive Recommender Systems. In today's business marketplace, many high tech Internet enterprises constantly explore innovative ways to provide optimal online user experiences for gaining competitive advantages. The great needs of developing intelligent interactive recommendation systems are indicated, which could sequentially suggest users the most proper items by accurately predicting their preferences, while receiving the up to date feedback to refine the recommendation results, continuously. Multi armed bandit algorithms, which have been widely applied into various online systems, are quite capable of delivering such efficient recommendation services. However, few existing bandit models are able to adapt to new changes introduced by the modern recommender systems.


OPlaceRAN a Placement Orchestrator for Virtualized Next Generation of Radio Access Network. The fifth generation mobile evolution enables transformations on Next Generation Radio Access Networks (NG RAN). The RAN protocol stack is split into eight disaggregated options combined in three network units, i.e., Central, Distributed, and Radio. Besides that, further advances allow the RAN functions to be virtualized on top of general purpose hardware, using the concept of virtualized RAN (vRAN). The Combination of NG RAN and vRAN results in vNG RAN, which enables the management of the disaggregated units and protocols as a set of radio functions. However, the orchestration based placement of these radio functions is a challenging issue since the best decision can be determined by multiple constraints involving RAN disaggregation, crosshaul networks requirements, availability of computational resources, etc. This article proposes OPlaceRAN, a vNG RAN deployment orchestrator framed within the NFV reference architecture and aligned with the Open RAN initiative. OPlaceRAN supports the dynamic placement of radio functions focusing on vNG RAN planning and is designed to be agnostic to the placement optimization model. To validate OPlaceRAN, we developed a prototype based on up to date cloud native tools to deploy RAN using containerized virtualization using the OpenAirInterface emulator and considering two distinct functional splits (options 2 and 6). The evaluation is tested as proofs of concept in a real computing infrastructure using two different placement solutions. Our results reveal that OPlaceRAN is an effective cloud native solution for containerized network functions placement and agnostic to the optimization model. Additionally, OPlaceRAN is up to date with the most advanced vNG RAN design and development approaches, contributing to the evolution of the fifth generation of mobile networks.


Rainbow Independent Sets in Cycles. For a given class cal C of graphs and given integers m le n , let f cal C (n,m) be the minimal number k such that every k independent n sets in any graph belonging to cal C have a (possibly partial) rainbow independent m set. In this paper, we consider the case cal C C 2s 1 and show that f C 2s 1 (s, s) s . Our result is a special case of the conjecture (Conjecture 2.9) proposed by Aharoni et al in cite Aharoni .


Semantic Segmentation of Legal Documents via Rhetorical Roles. Legal documents are unstructured, use legal jargon, and have considerable length, making it difficult to process automatically via conventional text processing techniques. A legal document processing system would benefit substantially if the documents could be semantically segmented into coherent units of information. This paper proposes a Rhetorical Roles (RR) system for segmenting a legal document into semantically coherent units facts, arguments, statute, issue, precedent, ruling, and ratio. With the help of legal experts, we propose a set of 13 fine grained rhetorical role labels and create a new corpus of legal documents annotated with the proposed RR. We develop a system for segmenting a document into rhetorical role units. In particular, we develop a multitask learning based deep learning model with document rhetorical role label shift as an auxiliary task for segmenting a legal document. We experiment extensively with various deep learning models for predicting rhetorical roles in a document, and the proposed model shows superior performance over the existing models. Further, we apply RR for predicting the judgment of legal cases and show that the use of RR enhances the prediction compared to the transformer based models.


As Easy as 1, 2, 3 Behavioural Testing of NMT Systems for Numerical Translation. Mistranslated numbers have the potential to cause serious effects, such as financial loss or medical misinformation. In this work we develop comprehensive assessments of the robustness of neural machine translation systems to numerical text via behavioural testing. We explore a variety of numerical translation capabilities a system is expected to exhibit and design effective test examples to expose system underperformance. We find that numerical mistranslation is a general issue major commercial systems and state of the art research models fail on many of our test examples, for high and low resource languages. Our tests reveal novel errors that have not previously been reported in NMT systems, to the best of our knowledge. Lastly, we discuss strategies to mitigate numerical mistranslation.


Advancing Behavior Engineering Toward Integrated Events Modeling. The term behavior engineering (BE) encompasses a broad integration of behavioral and compositional requirements needed to model large scale systems. BE forms a connection between systems engineering processes and software engineering processes. In software engineering, interpreting requirements can be perceived as specifying behavior, which is viewed in terms of chronology of events in the modeled system. In this paper, we adopt BE in its general and integrating sense to search for a unifying notion of an event as a fundamental behavior modeling concept. We examine several bodies of research with various definitions of an event and its basic units and structure. We use the thinging machine (TM) model to analyze notions related to events, including Dromey s behavior trees, fluents (change over time), recurrent events, and Davidson s events. The results point to an underlying meaning that can lead to a unifying event concept.


Minkowski bases, Korkin Zolotarev bases and successive minima. Let lambda k denote the k th successive minimum of a lattice L . We study properties of the lengths of certain bases of L . If v 1, dots v n is a basis which is reduced in the sense of Minkowski we show that lvert v k rvert 2 leq frac k 4 lambda k 2 for k 6, 7 , confirming a conjecture of Sch "urmann, and obtaining the first improvement of a classical bound by Van der Waerden. We construct a sequences of lattices where lvert v n rvert is significantly longer than the longest vector in a Korkin Zolotarev reduced basis, answering a question of Sch "urmann. In an appendix joint with Lior Hadassi we construct a lattice L with the surprising property that any basis containing the shortest vector of L is not the shortest basis.