SN Graph a Minimalist 3D Object Representation for Classification. Using deep learning techniques to process 3D objects has achieved many successes. However, few methods focus on the representation of 3D objects, which could be more effective for specific tasks than traditional representations, such as point clouds, voxels, and multi view images. In this paper, we propose a Sphere Node Graph (SN Graph) to represent 3D objects. Specifically, we extract a certain number of internal spheres (as nodes) from the signed distance field (SDF), and then establish connections (as edges) among the sphere nodes to construct a graph, which is seamlessly suitable for 3D analysis using graph neural network (GNN). Experiments conducted on the ModelNet40 dataset show that when there are fewer nodes in the graph or the tested objects are rotated arbitrarily, the classification accuracy of SN Graph is significantly higher than the state of the art methods.


Adaptive Sample Selection for Robust Learning under Label Noise. Deep Neural Networks (DNNs) have been shown to be susceptible to memorization or overfitting in the presence of noisily labelled data. For the problem of robust learning under such noisy data, several algorithms have been proposed. A prominent class of algorithms rely on sample selection strategies, motivated by curriculum learning. For example, many algorithms use the small loss trick' wherein a fraction of samples with loss values below a certain threshold are selected for training. These algorithms are sensitive to such thresholds, and it is difficult to fix or learn these thresholds. Often, these algorithms also require information such as label noise rates which are typically unavailable in practice. In this paper, we propose a data dependent, adaptive sample selection strategy that relies only on batch statistics of a given mini batch to provide robustness against label noise. The algorithm does not have any additional hyperparameters for sample selection, does not need any information on noise rates, and does not need access to separate data with clean labels. We empirically demonstrate the effectiveness of our algorithm on benchmark datasets.


Online Capacity Scaling Augmented With Unreliable Machine Learning Predictions. Modern data centers suffer from immense power consumption. As a result, data center operators have heavily invested in capacity scaling solutions, which dynamically deactivate servers if the demand is low and activate them again when the workload increases. We analyze a continuous time model for capacity scaling, where the goal is to minimize the weighted sum of flow time, switching cost, and power consumption in an online fashion. We propose a novel algorithm, called Adaptive Balanced Capacity Scaling (ABCS), that has access to black box machine learning predictions. ABCS aims to adapt to the predictions and is also robust against unpredictable surges in the workload. In particular, we prove that ABCS is (1 varepsilon) competitive if the predictions are accurate, and yet, it has a uniformly bounded competitive ratio even if the predictions are completely inaccurate. Finally, we investigate the performance of this algorithm on a real world dataset and carry out extensive numerical experiments, which positively support the theoretical results.


Multi Task Learning for User Engagement and Adoption in Live Video Streaming Events. Nowadays, live video streaming events have become a mainstay in viewer's communication in large international enterprises. Provided that viewers are distributed worldwide, the main challenge resides on how to schedule the optimal event's time so as to improve both the viewer's engagement and adoption. In this paper we present a multi task deep reinforcement learning model to select the time of a live video streaming event, aiming to optimize the viewer's engagement and adoption at the same time. We consider the engagement and adoption of the viewers as independent tasks and formulate a unified loss function to learn a common policy. In addition, we account for the fact that each task might have different contribution to the training strategy of the agent. Therefore, to determine the contribution of each task to the agent's training, we design a Transformer's architecture for the state action transitions of each task. We evaluate our proposed model on four real world datasets, generated by the live video streaming events of four large enterprises spanning from January 2019 until March 2021. Our experiments demonstrate the effectiveness of the proposed model when compared with several state of the art strategies. For reproduction purposes, our evaluation datasets and implementation are publicly available at https github.com stefanosantaris merlin.


SSS PRNU Privacy Preserving PRNU Based Camera Attribution using Shamir Secret Sharing. Photo Response Non Uniformity(PRNU) noise has proven to be very effective tool in camera based forensics. It helps to match a photo to the device that clicked it. In today's scenario, where millions and millions of images are uploaded every hour, it is very easy to compute this unique PRNU pattern from a couple of shared images on social profiles. This endangers the privacy of the camera owner and becomes a cause of major concern for the privacy aware society. We propose SSS PRNU scheme that facilitates the forensic investigators to carry out their crime investigation without breaching the privacy of the people. Thus, maintaining a balance between the two. To preserve privacy, extraction of camera fingerprint and PRNU noise for a suspicious image is computed in a trusted execution environment such as ARM TrustZone. After extraction, the sensitive information of camera fingerprint and PRNU noise is distributed into multiple obfuscated shares using Shamir secret sharing(SSS) scheme. These shares are information theoretically secure and leak no information of underlying content. The encrypted information is distributed to multiple third part servers where correlation is computed on a share basis between the camera fingerprint and the PRNU noise. These partial correlation values are combined together to obtain the final correlation value that becomes the basis for a match decision. Transforming the computation of the correlation value in the encrypted domain and making it well suited for a distributed environment is the main contribution of the paper. Experiment results validate the feasibility of the proposed scheme that provides a secure framework for PRNU based source camera attribution. The security analysis and evaluation of computational and storage overheads are performed to analysis the practical feasibility of the scheme.


Model Composition Can Multiple Neural Networks Be Combined into a Single Network Using Only Unlabeled Data?. The diversity of deep learning applications, datasets, and neural network architectures necessitates a careful selection of the architecture and data that match best to a target application. As an attempt to mitigate this dilemma, this paper investigates the idea of combining multiple trained neural networks using unlabeled data. In addition, combining multiple models into one can speed up the inference, result in stronger, more capable models, and allows us to select efficient device friendly target network architectures. To this end, the proposed method makes use of generation, filtering, and aggregation of reliable pseudo labels collected from unlabeled data. Our method supports using an arbitrary number of input models with arbitrary architectures and categories. Extensive performance evaluations demonstrated that our method is very effective. For example, for the task of object detection and without using any ground truth labels, an EfficientDet D0 trained on Pascal VOC and an EfficientDet D1 trained on COCO, can be combined to a RetinaNet ResNet50 model, with a similar mAP as the supervised training. If fine tuned in a semi supervised setting, the combined model achieves 18.6 , 12.6 , and 8.1 mAP improvements over supervised training with 1 , 5 , and 10 of labels.


Vanishing of cohomology and parameter rigidity of actions of solvable Lie groups. We give a sufficient condition for parameter rigidity of actions of solvable Lie groups, by vanishing of (uncountably many) first cohomologies of the orbit foliations. In some cases, we can prove that vanishing of finitely many cohomologies is sufficient. For this purpose we use a rigidity property of quasiisometry. As an application we prove some actions of 2 step solvable Lie groups on mapping tori are parameter rigid. Special cases of these actions are considered in a paper of Matsumoto and Mitsumatsu. We also remark on the relation between transitive locally free actions of solvable Lie groups and lattices in solvable Lie groups, and apply results in rigidity theory of lattices in solvable Lie groups to construct transitive locally free actions with some properties.


Efficient solution method based on inverse dynamics for optimal control problems of rigid body systems. We propose an efficient way of solving optimal control problems for rigid body systems on the basis of inverse dynamics and the multiple shooting method. We treat all variables, including the state, acceleration, and control input torques, as optimization variables and treat the inverse dynamics as an equality constraint. We eliminate the update of the control input torques from the linear equation of Newton's method by applying condensing for inverse dynamics. The size of the resultant linear equation is the same as that of the multiple shooting method based on forward dynamics except for the variables related to the passive joints and contacts. Compared with the conventional methods based on forward dynamics, the proposed method reduces the computational cost of the dynamics and their sensitivities by utilizing the recursive Newton Euler algorithm (RNEA) and its partial derivatives. In addition, it increases the sparsity of the Hessian of the Karush Kuhn Tucker conditions, which reduces the computational cost, e.g., of Riccati recursion. Numerical experiments show that the proposed method outperforms state of the art implementations of differential dynamic programming based on forward dynamics in terms of computational time and numerical robustness.


Input Specific Robustness Certification for Randomized Smoothing. Although randomized smoothing has demonstrated high certified robustness and superior scalability to other certified defenses, the high computational overhead of the robustness certification bottlenecks the practical applicability, as it depends heavily on the large sample approximation for estimating the confidence interval. In existing works, the sample size for the confidence interval is universally set and agnostic to the input for prediction. This Input Agnostic Sampling (IAS) scheme may yield a poor Average Certified Radius (ACR) runtime trade off which calls for improvement. In this paper, we propose Input Specific Sampling (ISS) acceleration to achieve the cost effectiveness for robustness certification, in an adaptive way of reducing the sampling size based on the input characteristic. Furthermore, our method universally controls the certified radius decline from the ISS sample size reduction. The empirical results on CIFAR 10 and ImageNet show that ISS can speed up the certification by more than three times at a limited cost of 0.05 certified radius. Meanwhile, ISS surpasses IAS on the average certified radius across the extensive hyperparameter settings. Specifically, ISS achieves ACR 0.958 on ImageNet ( sigma 1.0 ) in 250 minutes, compared to ACR 0.917 by IAS under the same condition. We release our code in url https github.com roy ch Input Specific Certification .


MTG A Benchmarking Suite for Multilingual Text Generation. We introduce MTG, a new benchmark suite for training and evaluating multilingual text generation. It is the first and largest text generation benchmark with 120k human annotated multi way parallel data for three tasks (story generation, question generation, and title generation) across four languages (English, German, French, and Spanish). Based on it, we set various evaluation scenarios and make a deep analysis of several popular multilingual generation models from different aspects. Our benchmark suite will encourage the multilingualism for text generation community with more human annotated parallel data and more diverse generation scenarios.


Varieties with ample Frobenius trace kernel. In the search of a projective analog of the Kunz's theorem and a Frobenius theoretic analog of the Hartshorne Mori's theorem, we investigate the positivity of the kernel of the Frobenius trace (equivalently, the negativity of the cokernel of the Frobenius endomorphism) on a smooth projective variety over an algebraically closed field of positive characteristic. For instance, such kernel is ample for projective spaces. Conversely, we show that for curves, surfaces, and threefolds the Frobenius trace kernel is ample only for Fano varieties of Picard rank 1 .


Interactive Visualization and Representation Analysis Applied to Glacier Segmentation. Interpretability has attracted increasing attention in earth observation problems. We apply interactive visualization and representation analysis to guide interpretation of glacier segmentation models. We visualize the activations from a U Net to understand and evaluate the model performance. We build an online interface using the Shiny R package to provide comprehensive error analysis of the predictions. Users can interact with the panels and discover model failure modes. Further, we discuss how visualization can provide sanity checks during data preprocessing and model training.


Decentralized Blockchain based model for Edge Computing. Blockchain technology is among the fastest growing technologies in the world today. It has been adopted in diverse areas but mostly in financial systems, such as Bitcoin cryptocurrency. Therefore, it is a niche that has attracted interest from researchers from various fields, including computer science. Other areas where Blockchain is being embraced are the Smart Grid and Internet of Things (IoT) technologies, among others. While it is all good and improving many areas of applications, Blockchain still has some shortcomings. For example, it is not designed for high scalability when accommodating normal transactions. On the other hand, a parallel technology that has diverse applications in distributed networks better known as edge computing has emerged. Its main advantage is that it increases the speed of pf processes within those networks. However, like Blockchain, edge computing has its shortcomings. Its security systems and management systems have been found to be wanting. Hence the idea to integrate the two technologies and take advantage of their strengths. A blend of the two would lead to advanced network servers, huge data storage, and heightened security in transactions. However, this integration will best happen when some measures are taken. For example, there is a need to address scalability, resource management satisfactorily, and the security of the systems. To solve the integration problem, a decentralized Blockchain based model of Edge computing is proposed in this paper.


Importance of Empirical Sample Complexity Analysis for Offline Reinforcement Learning. We hypothesize that empirically studying the sample complexity of offline reinforcement learning (RL) is crucial for the practical applications of RL in the real world. Several recent works have demonstrated the ability to learn policies directly from offline data. In this work, we ask the question of the dependency on the number of samples for learning from offline data. Our objective is to emphasize that studying sample complexity for offline RL is important, and is an indicator of the usefulness of existing offline algorithms. We propose an evaluation approach for sample complexity analysis of offline RL.


Financial Network Games. We study financial systems from a game theoretic standpoint. A financial system is represented by a network, where nodes correspond to firms, and directed labeled edges correspond to debt contracts between them. The existence of cycles in the network indicates that a payment of a firm to one of its lenders might result to some incoming payment. So, if a firm cannot fully repay its debt, then the exact (partial) payments it makes to each of its creditors can affect the cash inflow back to itself. We naturally assume that the firms are interested in their financial well being (utility) which is aligned with the amount of incoming payments they receive from the network. This defines a game among the firms, that can be seen as utility maximizing agents who can strategize over their payments. We are the first to study financial network games that arise under a natural set of payment strategies called priority proportional payments. We investigate the existence and (in)efficiency of equilibrium strategies, under different assumptions on how the firms' utility is defined, on the types of debt contracts allowed between the firms, and on the presence of other financial features that commonly arise in practice. Surprisingly, even if all firms' strategies are fixed, the existence of a unique payment profile is not guaranteed. So, we also investigate the existence and computation of valid payment profiles for fixed payment strategies.


The Effect of Q function Reuse on the Total Regret of Tabular, Model Free, Reinforcement Learning. Some reinforcement learning methods suffer from high sample complexity causing them to not be practical in real world situations. Q function reuse, a transfer learning method, is one way to reduce the sample complexity of learning, potentially improving usefulness of existing algorithms. Prior work has shown the empirical effectiveness of Q function reuse for various environments when applied to model free algorithms. To the best of our knowledge, there has been no theoretical work showing the regret of Q function reuse when applied to the tabular, model free setting. We aim to bridge the gap between theoretical and empirical work in Q function reuse by providing some theoretical insights on the effectiveness of Q function reuse when applied to the Q learning with UCB Hoeffding algorithm. Our main contribution is showing that in a specific case if Q function reuse is applied to the Q learning with UCB Hoeffding algorithm it has a regret that is independent of the state or action space. We also provide empirical results supporting our theoretical findings.


Effective guessing has unlikely consequences. A classic result of Paul, Pippenger, Szemer 'edi and Trotter states that DTIME(n) is strictly contained in NTIME(n). The natural question then arises could DTIME(t(n)) be contained in NTIME(n) for some superlinear time constructible function t(n)? If such a function t(n) does exist, then there also exist effective nondeterministic guessing strategies to speed up deterministic computations. In this work, we prove limitations on the effectiveness of nondeterministic guessing to speed up deterministic computations by showing that the existence of effective nondeterministic guessing strategies would have unlikely consequences. In particular, we show that if a subpolynomial amount of nondeterministic guessing could be used to speed up deterministic computation by a polynomial factor, then P is strictly contained in NTIME(n). Furthermore, even achieving a logarithmic speedup at the cost of making every step nondeterministic would show that SAT is in NTIME(n) under appropriate encodings. Of possibly independent interest, under such encodings we also show that SAT can be decided in O(n lg n) steps on a nondeterministic multitape Turing machine, improving on the well known O(n(lg n) c) bound for some constant but undetermined exponent c which is at least 1.


Adversarial Deep Learning for Online Resource Allocation. Online algorithm is an important branch in algorithm design. Designing online algorithms with a bounded competitive ratio (in terms of worst case performance) can be hard and usually relies on problem specific assumptions. Inspired by adversarial training from Generative Adversarial Net (GAN) and the fact that competitive ratio of an online algorithm is based on worst case input, we adopt deep neural networks to learn an online algorithm for a resource allocation and pricing problem from scratch, with the goal that the performance gap between offline optimum and the learned online algorithm can be minimized for worst case input. Specifically, we leverage two neural networks as algorithm and adversary respectively and let them play a zero sum game, with the adversary being responsible for generating worst case input while the algorithm learns the best strategy based on the input provided by the adversary. To ensure better convergence of the algorithm network (to the desired online algorithm), we propose a novel per round update method to handle sequential decision making to break complex dependency among different rounds so that update can be done for every possible action, instead of only sampled actions. To the best of our knowledge, our work is the first using deep neural networks to design an online algorithm from the perspective of worst case performance guarantee. Empirical studies show that our updating methods ensure convergence to Nash equilibrium and the learned algorithm outperforms state of the art online algorithms under various settings.


Learning Vision Guided Dynamic Locomotion Over Challenging Terrains. Legged robots are becoming increasingly powerful and popular in recent years for their potential to bring the mobility of autonomous agents to the next level. This work presents a deep reinforcement learning approach that learns a robust Lidar based perceptual locomotion policy in a partially observable environment using Proximal Policy Optimisation. Visual perception is critical to actively overcome challenging terrains, and to do so, we propose a novel learning strategy Dynamic Reward Strategy (DRS), which serves as effective heuristics to learn a versatile gait using a neural network architecture without the need to access the history data. Moreover, in a modified version of the OpenAI gym environment, the proposed work is evaluated with scores over 90 success rate in all tested challenging terrains.


Topological Semantic Mapping by Consolidation of Deep Visual Features. Many works in the recent literature introduce semantic mapping methods that use CNNs (Convolutional Neural Networks) to recognize semantic properties in images. The types of properties (eg. room size, place category, and objects) and their classes (eg. kitchen and bathroom, for place category) are usually predefined and restricted to a specific task. Thus, all the visual data acquired and processed during the construction of the maps are lost and only the recognized semantic properties remain on the maps. In contrast, this work introduces a topological semantic mapping method that uses deep visual features extracted by a CNN (GoogLeNet), from 2D images captured in multiple views of the environment as the robot operates, to create, through averages, consolidated representations of the visual features acquired in the regions covered by each topological node. These representations allow flexible recognition of semantic properties of the regions and use in other visual tasks. Experiments with a real world indoor dataset showed that the method is able to consolidate the visual features of regions and use them to recognize objects and place categories as semantic properties, and to indicate the topological location of images, with very promising results.


Reward Mechanism for Blockchains Using Evolutionary Game Theory. Blockchains have witnessed widespread adoption in the past decade in various fields. The growing demand makes their scalability and sustainability challenges more evident than ever. As a result, more and more blockchains have begun to adopt proof of stake (PoS) consensus protocols to address those challenges. One of the fundamental characteristics of any blockchain technology is its crypto economics and incentives. Lately, each PoS blockchain has designed a unique reward mechanism, yet, many of them are prone to free rider and nothing at stake problems. To better understand the ad hoc design of reward mechanisms, in this paper, we develop a reward mechanism framework that could apply to many PoS blockchains. We formulate the block validation game wherein the rewards are distributed for validating the blocks correctly. Using evolutionary game theory, we analyze how the participants' behaviour could potentially evolve with the reward mechanism. Also, penalties are found to play a central role in maintaining the integrity of blockchains.


SINA Smart Interoperability Architecture An architecture fostering the interoperability between smart building technology from different manufacturers and smart grid infrastructure to enable new business models for energy services. More and more household appliances connect to the Internet and exchange data freely. This is the foundation for true smart buildings. However, there is still no uniform communication technology available, which can connect all appliances from all vendors. Protocols differ between manufacturers making interoperability difficult or even impossible. Manufacturers cannot rely on a reference for the implementation and real estate developers and operators are reluctant to commit to a system until it is clear which one will prevail. A similar situation is evident in smart grids and applies equally to the energy supply industry. This fragmentation ultimately leads to missed opportunities in terms of business models which could connect customers with service providers. We present a first draft of an architecture SINA Smart Interoperability Architecture. SINA is based on existing decentralized infrastructure, which avoids creating a dependency of the market participants on an overpowering service provider. The core element of the technical solution is an open source module integrated in the private clouds of the manufacturers, energy suppliers and service providers. The architecture addresses problems of data ownership, privacy and data security avoiding central administrative structures. It manages data access and transfer in a decentralized and distributed system. SINA uses a blockchain and smart contracts to make sure that the pieces of information about which data are accessed, by whom they are accessed, how they are processed, and which monetary transactions take place are immutably stored and made available. This allows providers to offer services to users in a transparent and trustworthy manner. Finally, SINA includes a matchmaking block which helps service providers find potential customers and vice versa. This set of features makes SINA unique.


Seminormalization and regulous functions on complex affine varieties. We study seminormalization of affine complex varieties. We show that polynomials on the seminormalization correspond to the rational functions which are continuous for the Euclidean topology. We further study this type of functions which can be seen as complex regulous functions, a class of functions recently introduced in real algebraic geometry, or as the algebraic counterpart of c holomorphic functions.


Intrusion Detection using Spatial Temporal features based on Riemannian Manifold. Network traffic data is a combination of different data bytes packets under different network protocols. These traffic packets have complex time varying non linear relationships. Existing state of the art methods rise up to this challenge by fusing features into multiple subsets based on correlations and using hybrid classification techniques that extract spatial and temporal characteristics. This often requires high computational cost and manual support that limit them for real time processing of network traffic. To address this, we propose a new novel feature extraction method based on covariance matrices that extract spatial temporal characteristics of network traffic data for detecting malicious network traffic behavior. The covariance matrices in our proposed method not just naturally encode the mutual relationships between different network traffic values but also have well defined geometry that falls in the Riemannian manifold. Riemannian manifold is embedded with distance metrics that facilitate extracting discriminative features for detecting malicious network traffic. We evaluated our model on NSL KDD and UNSW NB15 datasets and showed our proposed method significantly outperforms the conventional method and other existing studies on the dataset.


Readability and Understandability Scores for Snippet Assessment an Exploratory Study. Code search engines usually use readability feature to rank code snippets. There are several metrics to calculate this feature, but developers may have different perceptions about readability. Correlation between readability and understandability features has already been proposed, i.e., developers need to read and comprehend the code snippet syntax, but also understand the semantics. This work investigate scores for understandability and readability features, under the perspective of the possible subjective perception of code snippet comprehension. We find that code snippets with higher readability score has better comprehension than lower ones. The understandability score presents better comprehension in specific situations, e.g. nested loops or if else chains. The developers also mentioned writability aspects as the principal characteristic to evaluate code snippets comprehension. These results provide insights for future works in code comprehension score optimization.


Semifinite harmonic functions on branching graphs. We study semifinite harmonic functions on arbitrary branching graphs. We give a detailed exposition of an algebraic method which allows one to classify semifinite indecomposable harmonic functions on some multiplicative branching graphs. This method was proposed by A. Wassermann in terms of operator algebras, while we rephrase, clarify, and simplify the main arguments, working only with combinatorial objects. This work was inspired by the theory of traceable factor representations of the infinite symmetric group S( infty) .


Partially Hidden Markov Chain Linear Autoregressive model inference and forecasting. Time series subject to change in regime have attracted much interest in domains such as econometry, finance or meteorology. For discrete valued regimes, some models such as the popular Hidden Markov Chain (HMC) describe time series whose state process is unknown at all time steps. Sometimes, time series are firstly labelled thanks to some annotation function. Thus, another category of models handles the case with regimes observed at all time steps. We present a novel model which addresses the intermediate case (i) state processes associated to such time series are modelled by Partially Hidden Markov Chains (PHMCs) (ii) a linear autoregressive (LAR) model drives the dynamics of the time series, within each regime. We describe a variant of the expection maximization (EM) algorithm devoted to PHMC LAR model learning. We propose a hidden state inference procedure and a forecasting function that take into account the observed states when existing. We assess inference and prediction performances, and analyze EM convergence times for the new model, using simulated data. We show the benefits of using partially observed states to decrease EM convergence times. A fully labelled scheme with unreliable labels also speeds up EM. This offers promising prospects to enhance PHMC LAR model selection. We also point out the robustness of PHMC LAR to labelling errors in inference task, when large training datasets and moderate labelling error rates are considered. Finally, we highlight the remarkable robustness to error labelling in the prediction task, over the whole range of error rates.


On the principal eigenvector of a graph. The principal ratio of a connected graph G , gamma(G) , is the ratio between the largest and smallest coordinates of the principal eigenvector of the adjacency matrix of G . Over all connected graphs on n vertices, gamma(G) ranges from 1 to n cn . Moreover, gamma(G) 1 if and only if G is regular. This indicates that gamma(G) can be viewed as an irregularity measure of G , as first suggested by Tait and Tobin (El. J. Lin. Alg. 2018). We are interested in how stable this measure is. In particular, we ask how gamma changes when there is a small modification to a regular graph G . We show that this ratio is polynomially bounded if we remove an edge belonging to a cycle of bounded length in G , while the ratio can jump from 1 to exponential if we join a pair of vertices at distance 2 . We study the connection between the spectral gap of a regular graph and the stability of its principal ratio. A naive bound shows that given a constant multiplicative spectral gap and bounded degree, the ratio remains polynomially bounded if we add or delete an edge. Using results from matrix perturbation theory, we show that given an additive spectral gap greater than (2 epsilon) sqrt n , the ratio stays bounded after adding or deleting an edge.


ConE A Concurrent Edit Detection Tool for Large Scale Software Development. Modern, complex software systems are being continuously extended and adjusted. The developers responsible for this may come from different teams or organizations, and may be distributed over the world. This may make it difficult to keep track of what other developers are doing, which may result in multiple developers concurrently editing the same code areas. This, in turn, may lead to hard to merge changes or even merge conflicts, logical bugs that are difficult to detect, duplication of work, and wasted developer productivity. To address this, we explore the extent of this problem in the pull request based software development model. We study half a year of changes made to six large repositories in Microsoft in which at least 1,000 pull requests are created each month. We find that files concurrently edited in different pull requests are more likely to introduce bugs. Motivated by these findings, we design, implement, and deploy a service named ConE (Concurrent Edit Detector) that proactively detects pull requests containing concurrent edits, to help mitigate the problems caused by them. ConE has been designed to scale, and to minimize false alarms while still flagging relevant concurrently edited files. Key concepts of ConE include the detection of the Extent of Overlap between pull requests, and the identification of Rarely Concurrently Edited Files. To evaluate ConE, we report on its operational deployment on 234 repositories inside Microsoft. ConE assessed 26,000 pull requests and made 775 recommendations about conflicting changes, which were rated as useful in over 70 (554) of the cases. From interviews with 48 users we learned that they believed ConE would save time in conflict resolution and avoiding duplicate work, and that over 90 intend to keep using the service on a daily basis.


Toric and tropical Bertini theorems in positive characteristic. We generalize the toric Bertini theorem of Fuchs, Mantova, and Zannier to positive characteristic. A key part of the proof is a new algebraically closed field containing the field kk(t 1, dots,t d) of rational functions over an algebraically closed field kk of prime characteristic. As a corollary, we extend the tropical Bertini theorem of Maclagan and Yu to arbitrary characteristic, which removes the characteristic dependence from the d connectivity result for tropical varieties from that paper.


Enriching a CP Net by Asymmetric Merging. Conditional ceteris paribus preference networks (CP nets) are commonly used to capture qualitative conditional preferences. In many use cases, when the preferential structure of an agent is incomplete, information from other preferential structures (e.g. that of other users) preferences can be used to fill in the gaps. Earlier works proposed methods to symmetrically merge multiple incomplete CP nets by means of voting semantics. However, the merged CP net can contain preference relations that do not fit to a given user's original preference profile. This paper proposes an asymmetric merging (or enriching) method to obtain and fill in preference relations of a user's CP net from another CP net in a way that preserves the original preference relations.


End to End Trainable Multi Instance Pose Estimation with Transformers. We propose an end to end trainable approach for multi instance pose estimation, called POET (POse Estimation Transformer). Combining a convolutional neural network with a transformer encoder decoder architecture, we formulate multiinstance pose estimation from images as a direct set prediction problem. Our model is able to directly regress the pose of all individuals, utilizing a bipartite matching scheme. POET is trained using a novel set based global loss that consists of a keypoint loss, a visibility loss and a class loss. POET reasons about the relations between multiple detected individuals and the full image context to directly predict their poses in parallel. We show that POET achieves high accuracy on the COCO keypoint detection task while having less parameters and higher inference speed than other bottom up and top down approaches. Moreover, we show successful transfer learning when applying POET to animal pose estimation. To the best of our knowledge, this model is the first end to end trainable multi instance pose estimation method and we hope it will serve as a simple and promising alternative.


Improving Contrastive Learning by Visualizing Feature Transformation. Contrastive learning, which aims at minimizing the distance between positive pairs while maximizing that of negative ones, has been widely and successfully applied in unsupervised feature learning, where the design of positive and negative (pos neg) pairs is one of its keys. In this paper, we attempt to devise a feature level data manipulation, differing from data augmentation, to enhance the generic contrastive self supervised learning. To this end, we first design a visualization scheme for pos neg score (Pos neg score indicates cosine similarity of pos neg pair.) distribution, which enables us to analyze, interpret and understand the learning process. To our knowledge, this is the first attempt of its kind. More importantly, leveraging this tool, we gain some significant observations, which inspire our novel Feature Transformation proposals including the extrapolation of positives. This operation creates harder positives to boost the learning because hard positives enable the model to be more view invariant. Besides, we propose the interpolation among negatives, which provides diversified negatives and makes the model more discriminative. It is the first attempt to deal with both challenges simultaneously. Experiment results show that our proposed Feature Transformation can improve at least 6.0 accuracy on ImageNet 100 over MoCo baseline, and about 2.0 accuracy on ImageNet 1K over the MoCoV2 baseline. Transferring to the downstream tasks successfully demonstrate our model is less task bias. Visualization tools and codes https github.com DTennant CL Visualizing Feature Transformation .


SHREC 2021 Track on Skeleton based Hand Gesture Recognition in the Wild. Gesture recognition is a fundamental tool to enable novel interaction paradigms in a variety of application scenarios like Mixed Reality environments, touchless public kiosks, entertainment systems, and more. Recognition of hand gestures can be nowadays performed directly from the stream of hand skeletons estimated by software provided by low cost trackers (Ultraleap) and MR headsets (Hololens, Oculus Quest) or by video processing software modules (e.g. Google Mediapipe). Despite the recent advancements in gesture and action recognition from skeletons, it is unclear how well the current state of the art techniques can perform in a real world scenario for the recognition of a wide set of heterogeneous gestures, as many benchmarks do not test online recognition and use limited dictionaries. This motivated the proposal of the SHREC 2021 Track on Skeleton based Hand Gesture Recognition in the Wild. For this contest, we created a novel dataset with heterogeneous gestures featuring different types and duration. These gestures have to be found inside sequences in an online recognition scenario. This paper presents the result of the contest, showing the performances of the techniques proposed by four research groups on the challenging task compared with a simple baseline method.


Shaking Syntactic Trees on the Sesame Street Multilingual Probing with Controllable Perturbations. Recent research has adopted a new experimental field centered around the concept of text perturbations which has revealed that shuffled word order has little to no impact on the downstream performance of Transformer based language models across many NLP tasks. These findings contradict the common understanding of how the models encode hierarchical and structural information and even question if the word order is modeled with position embeddings. To this end, this paper proposes nine probing datasets organized by the type of emph controllable text perturbation for three Indo European languages with a varying degree of word order flexibility English, Swedish and Russian. Based on the probing analysis of the M BERT and M BART models, we report that the syntactic sensitivity depends on the language and model pre training objectives. We also find that the sensitivity grows across layers together with the increase of the perturbation granularity. Last but not least, we show that the models barely use the positional information to induce syntactic trees from their intermediate self attention and contextualized representations.


Fingerprint Matching using the Onion Peeling Approach and Turning Function. Fingerprint, as one of the most popular and robust biometric traits, can be used in automatic identification and verification systems to identify individuals. Fingerprint matching is a vital and challenging issue in fingerprint recognition systems. Most fingerprint matching algorithms are minutiae based. The minutiae in fingerprints can be determined by their discontinuity. Ridge ending and ridge bifurcation are two frequently used minutiae in most fingerprint based matching algorithms. This paper presents a new minutiae based fingerprint matching using the onion peeling approach. In the proposed method, fingerprints are aligned to find the matched minutiae points. Then, the nested convex polygons of matched minutiae points are constructed and the comparison between peer to peer polygons is performed by the turning function distance. Simplicity, accuracy, and low time complexity of the Onion peeling approach are three important factors that make it a standard method for fingerprint matching purposes. The performance of the proposed algorithm is evaluated on the database FVC2002 . The results show that fingerprints of the same fingers have higher scores than different fingers. Since the fingerprints that the difference between the number of their layers is more than 2 and the minutiae matching score lower than 0.15 are ignored, the better results are obtained.


Early and in season crop type mapping without current year ground truth generating labels from historical information via a topology based approach. Land cover classification in remote sensing is often faced with the challenge of limited ground truth. Incorporating historical information has the potential to significantly lower the expensive cost associated with collecting ground truth and, more importantly, enable early and in season mapping that is helpful to many pre harvest decisions. In this study, we propose a new approach that can effectively transfer knowledge about the topology (i.e. relative position) of different crop types in the spectral feature space (e.g. the histogram of SWIR1 vs RDEG1 bands) to generate labels, thereby support crop classification in a different year. Importantly, our approach does not attempt to transfer classification decision boundaries that are susceptible to inter annual variations of weather and management, but relies on the more robust and shift invariant topology information. We tested this approach for mapping corn soybeans in the US Midwest and paddy rice corn soybeans in Northeast China using Landsat 8 and Sentinel 2 data. Results show that our approach automatically generates high quality labels for crops in the target year immediately after each image becomes available. Based on these generated labels from our approach, the subsequent crop type mapping using a random forest classifier reach the F1 score as high as 0.887 for corn as early as the silking stage and 0.851 for soybean as early as the flowering stage and the overall accuracy of 0.873 in Iowa. In Northeast China, F1 scores of paddy rice, corn and soybeans and the overall accuracy can exceed 0.85 two and half months ahead of harvest. Overall, these results highlight unique advantages of our approach in transferring historical knowledge and maximizing the timeliness of crop maps. Our approach supports a general paradigm shift towards learning transferrable and generalizable knowledge to facilitate land cover classification.


DivAug Plug in Automated Data Augmentation with Explicit Diversity Maximization. Human designed data augmentation strategies have been replaced by automatically learned augmentation policy in the past two years. Specifically, recent work has empirically shown that the superior performance of the automated data augmentation methods stems from increasing the diversity of augmented data cite autoaug, randaug . However, two factors regarding the diversity of augmented data are still missing 1) the explicit definition (and thus measurement) of diversity and 2) the quantifiable relationship between diversity and its regularization effects. To bridge this gap, we propose a diversity measure called Variance Diversity and theoretically show that the regularization effect of data augmentation is promised by Variance Diversity. We validate in experiments that the relative gain from automated data augmentation in test accuracy is highly correlated to Variance Diversity. An unsupervised sampling based framework, textbf DivAug , is designed to directly maximize Variance Diversity and hence strengthen the regularization effect. Without requiring a separate search process, the performance gain from DivAug is comparable with the state of the art method with better efficiency. Moreover, under the semi supervised setting, our framework can further improve the performance of semi supervised learning algorithms compared to RandAugment, making it highly applicable to real world problems, where labeled data is scarce. The code is available at texttt url https github.com warai 0toko DivAug .


Analysis of key flavors of event driven predictive maintenance using logs of phenomena described by Weibull distributions. This work explores two approaches to event driven predictive maintenance in Industry 4.0 that cast the problem at hand as a classification or a regression one, respectively, using as a starting point two state of the art solutions. For each of the two approaches, we examine different data preprocessing techniques, different prediction algorithms and the impact of ensemble and sampling methods. Through systematic experiments regarding the aspectsmentioned above,we aimto understand the strengths of the alternatives, and more importantly, shed light on how to navigate through the vast number of such alternatives in an informed manner. Our work constitutes a key step towards understanding the true potential of this type of data driven predictive maintenance as of to date, and assist practitioners in focusing on the aspects that have the greatest impact.


Co even domination number of graphs constructed by removal or contraction of a vertex (an edge). Let G (V,E) be a simple graph. A dominating set of G is a subset D subseteq V such that every vertex not in D is adjacent to at least one vertex in D . The cardinality of a smallest dominating set of G , denoted by gamma(G) , is the domination number of G . A dominating set D is called co even dominating set if the degree of vertex v is even number for all v in V D . The cardinality of a smallest co even dominating set of G , denoted by gamma coe (G) , is the co even domination number of G . In this paper we study co even domination number of graphs which constructed by some operations on a vertex or an edge of a graph


PL2 Towards Predictable Low Latency in Rack Scale Networks. High performance rack scale offerings package disaggregated pools of compute, memory and storage hardware in a single rack to run diverse workloads with varying requirements, including applications that need low and predictable latency. The intra rack network is typically high speed Ethernet, which can suffer from congestion leading to packet drops and may not satisfy the stringent tail latency requirements for some workloads (including remote memory storage accesses). In this paper, we design a Predictable Low Latency(PL2) network architecture for rack scale systems with Ethernet as interconnecting fabric. PL2 leverages programmable Ethernet switches to carefully schedule packets such that they incur no loss with NIC and switch queues maintained at small, near zero levels. In our 100 Gbps rack prototype, PL2 keeps 99th percentile memcached RPC latencies under 60us even when the RPCs compete with extreme offered loads of 400 , without losing traffic. Network transfers for a machine learning training task complete 30 faster than a receiver driven scheme implementation modeled after Homa (222ms vs 321ms 99 ile latency per iteration).


Markov Switching Model for Driver Behavior Prediction Use cases on Smartphones. Several intelligent transportation systems focus on studying the various driver behaviors for numerous objectives. This includes the ability to analyze driver actions, sensitivity, distraction, and response time. As the data collection is one of the major concerns for learning and validating different driving situations, we present a driver behavior switching model validated by a low cost data collection solution using smartphones. The proposed model is validated using a real dataset to predict the driver behavior in short duration periods. A literature survey on motion detection (specifically driving behavior detection using smartphones) is presented. Multiple Markov Switching Variable Auto Regression (MSVAR) models are implemented to achieve a sophisticated fitting with the collected driver behavior data. This yields more accurate predictions not only for driver behavior but also for the entire driving situation. The performance of the presented models together with a suitable model selection criteria is also presented. The proposed driver behavior prediction framework can potentially be used in accident prediction and driver safety systems.


Learning an optimal feedback operator semiglobally stabilizing semilinear parabolic equations. Stabilizing feedback operators are presented which depend only on the orthogonal projection of the state onto the finite dimensional control space. A class of monotone feedback operators mapping the finite dimensional control space into itself is considered. The special case of the scaled identity operator is included. Conditions are given on the set of actuators and on the magnitude of the monotonicity, which guarantee the semiglobal stabilizing property of the feedback for a class semilinear parabolic like equations. Subsequently an optimal feedback control minimizing the quadratic energy cost is computed by a deep neural network, exploiting the fact that the feedback depends only on a finite dimensional component of the state. Numerical simulations demonstrate the stabilizing performance of explicitly scaled orthogonal projection feedbacks, and of deep neural network feedbacks.


Asymptotically rigid mapping class groups II strand diagrams and nonpositive curvature. In this article, we introduce a new family of groups, called Chambord groups and constructed from braided strand diagrams associated to specific semigroup presentations. It includes the asymptotically rigid mapping class groups previously studied by the authors such as the braided Higman Thompson groups and the braided Houghton groups. Our main result shows that polycyclic subgroups in Chambord groups are virtually abelian and undistorted.


Zero Shot Certified Defense against Adversarial Patches with Vision Transformers. Adversarial patch attack aims to fool a machine learning model by arbitrarily modifying pixels within a restricted region of an input image. Such attacks are a major threat to models deployed in the physical world, as they can be easily realized by presenting a customized object in the camera view. Defending against such attacks is challenging due to the arbitrariness of patches, and existing provable defenses suffer from poor certified accuracy. In this paper, we propose PatchVeto, a zero shot certified defense against adversarial patches based on Vision Transformer (ViT) models. Rather than training a robust model to resist adversarial patches which may inevitably sacrifice accuracy, PatchVeto reuses a pretrained ViT model without any additional training, which can achieve high accuracy on clean inputs while detecting adversarial patched inputs by simply manipulating the attention map of ViT. Specifically, each input is tested by voting over multiple inferences with different attention masks, where at least one inference is guaranteed to exclude the adversarial patch. The prediction is certifiably robust if all masked inferences reach consensus, which ensures that any adversarial patch would be detected with no false negative. Extensive experiments have shown that PatchVeto is able to achieve high certified accuracy (e.g. 67.1 on ImageNet for 2 pixel adversarial patches), significantly outperforming state of the art methods. The clean accuracy is the same as vanilla ViT models (81.8 on ImageNet) since the model parameters are directly reused. Meanwhile, our method can flexibly handle different adversarial patch sizes by simply changing the masking strategy.


Knowledge Hypergraph Embedding Meets Relational Algebra. Embedding based methods for reasoning in knowledge hypergraphs learn a representation for each entity and relation. Current methods do not capture the procedural rules underlying the relations in the graph. We propose a simple embedding based model called ReAlE that performs link prediction in knowledge hypergraphs (generalized knowledge graphs) and can represent high level abstractions in terms of relational algebra operations. We show theoretically that ReAlE is fully expressive and provide proofs and empirical evidence that it can represent a large subset of the primitive relational algebra operations, namely renaming, projection, set union, selection, and set difference. We also verify experimentally that ReAlE outperforms state of the art models in knowledge hypergraph completion, and in representing each of these primitive relational algebra operations. For the latter experiment, we generate a synthetic knowledge hypergraph, for which we design an algorithm based on the Erdos R'enyi model for generating random graphs.


Rethinking Supervised Pre training for Better Downstream Transferring. The pretrain finetune paradigm has shown outstanding performance on many applications of deep learning, where a model is pre trained on a upstream large dataset (e.g. ImageNet), and is then fine tuned to different downstream tasks. Though for most cases, the pre training stage is conducted based on supervised methods, recent works on self supervised pre training have shown powerful transferability and even outperform supervised pre training on multiple downstream tasks. It thus remains an open question how to better generalize supervised pre training model to downstream tasks. In this paper, we argue that the worse transferability of existing supervised pre training methods arise from the negligence of valuable intra class semantic difference. This is because these methods tend to push images from the same class close to each other despite of the large diversity in their visual contents, a problem to which referred as "overfit of upstream tasks". To alleviate this problem, we propose a new supervised pre training method based on Leave One Out K Nearest Neighbor, or LOOK for short. It relieves the problem of overfitting upstream tasks by only requiring each image to share its class label with most of its k nearest neighbors, thus allowing each class to exhibit a multi mode distribution and consequentially preserving part of intra class difference for better transferring to downstream tasks. We developed efficient implementation of the proposed method that scales well to large datasets. Experimental studies on multiple downstream tasks show that LOOK outperforms other state of the art methods for supervised and self supervised pre training.


Multi Scale Feature Fusion Learning Better Semantic Segmentation for Road Pothole Detection. This paper presents a novel pothole detection approach based on single modal semantic segmentation. It first extracts visual features from input images using a convolutional neural network. A channel attention module then reweighs the channel features to enhance the consistency of different feature maps. Subsequently, we employ an atrous spatial pyramid pooling module (comprising of atrous convolutions in series, with progressive rates of dilation) to integrate the spatial context information. This helps better distinguish between potholes and undamaged road areas. Finally, the feature maps in the adjacent layers are fused using our proposed multi scale feature fusion module. This further reduces the semantic gap between different feature channel layers. Extensive experiments were carried out on the Pothole 600 dataset to demonstrate the effectiveness of our proposed method. The quantitative comparisons suggest that our method achieves the state of the art (SoTA) performance on both RGB images and transformed disparity images, outperforming three SoTA single modal semantic segmentation networks.


Intelligent Reflecting Surface Aided Wireless Energy and Information Transmission An Overview. Intelligent reflecting surface (IRS) is a promising technology for achieving spectrum and energy efficient wireless networks cost effectively. Most existing works on IRS have focused on exploiting IRS to enhance the performance of wireless communication or wireless information transmission (WIT), while its potential for boosting the efficiency of radio frequency (RF) wireless energy transmission (WET) still remains largely open. Although IRS aided WET shares similar characteristics with IRS aided WIT, they differ fundamentally in terms of design objective, receiver architecture, and practical constraints. In this paper, we provide a tutorial overview on how to efficiently design IRS aided WET systems as well as IRS aided systems with both WIT and WET, namely IRS aided simultaneous wireless information and power transfer (SWIPT) and IRS aided wireless powered communication network (WPCN), mainly from a communication and signal processing perspective. In particular, we present state of the art solutions to tackle the unique challenges in operating these systems, such as IRS passive reflection optimization, channel estimation and deployment. In addition, we also propose new solution approaches and point out important directions for future research and investigation.


A representation formula for members of SBV dual. We give an integral representation formula for members of the dual of SBV( mathbb R n) in terms of functions that are defined on hat mathbb R n , an appropriate fiber space that we introduce, consisting of pairs (x, E x) where E x is an approximate germ of an (n 1) rectifiable set E at x .


Submodularity and Local Search Approaches for Maximum Capture Problems under Generalized Extreme Value Models. We study the maximum capture problem in facility location under random utility models, i.e., the problem of seeking to locate new facilities in a competitive market such that the captured user demand is maximized, assuming that each customer chooses among all available facilities according to a random utility maximization model. We employ the generalized extreme value (GEV) family of discrete choice models and show that the objective function in this context is monotonic and submodular. This finding implies that a simple greed heuristic can always guarantee an (1 1 e) approximation solution. We further develop a new algorithm combining a greedy heuristic, a gradient based local search and an exchanging procedure to efficiently solve the problem. We conduct experiments using instances of difference sizes and under different discrete choice models, and we show that our approach significantly outperforms prior approaches in terms of both returned objective value and CPU time. Our algorithm and theoretical findings can be applied to the maximum capture problems under various random utility models in the literature, including the popular multinomial logit, nested logit, cross nested logit, and the mixed logit models.


Fundamental optical linewidth of soliton microcombs. Soliton microcombs provide a versatile platform for realizing fundamental studies and technological applications. To be utilized as frequency rulers for precision metrology, soliton microcombs must display broadband phase coherence, a parameter characterized by the optical phase or frequency noise of the comb lines and their corresponding optical linewidths. Here, we analyze the optical phase noise dynamics in soliton microcombs and show that, because of the Raman self frequency shift, the fundamental linewidth of some of the comb lines can, surprisingly, be narrower than the linewidth of the pump laser. This work elucidates information about the ultimate limits in phase coherence of soliton microcombs and illustrates a new strategy for the generation of spectrally coherent light on chip.


A privacy aware zero interaction smart mobility system. Smart cities often rely on technological innovation to improve citizens' safety and quality of life. This paper presents a novel smart mobility system that aims to facilitate people accessing public mobility while preserving their privacy. The system is based on a zero interaction approach whereby a person can use public transport services without any need to perform explicit actions. Operations related to ticket purchase and validation have been fully automated. The system is also designed with the privacy by design paradigm in mind, to preserve user privacy as much as possible. Throughout the paper several technical details are discussed as well to describe a prototype version of the system that was implemented. The prototype has been successfully tested in the city of Imola (Emilia Romagna, Italy) in order to prove the system validity on the field.


A Cognitive and Machine Learning Based Software Development Paradigm Supported by Context. Advances in the use of cognitive and machine learning (ML) enabled systems fuel the quest for novel approaches and tools to support software developers in executing their tasks. First, as software development is a complex and dynamic activity, these tasks are highly dependent on the characteristics of the software project and its context, and developers need comprehensive support in terms of information and guidance based on the task context. Second, there is a lack of methods based on conversational guided agents that consider cognitive aspects such as paying attention and remembering. Third, there is also a lack of techniques that make use of historical implicit or tacit data to infer new knowledge about the project tasks such as related tasks, task experts, relevant information needed for task completion and warnings, and navigation aspects of the process such as what tasks to perform next and optimal task sequencing. Based on these challenges, this paper introduces a novel paradigm for human machine software support based on context, cognitive assistance, and machine learning, and briefly describes ongoing research activities to realize this paradigm. The research takes advantage of the synergy among emergent methods provided in context aware software processes, cognitive computing such as chatbots, and machine learning such as recommendation systems. These novel paradigms have the potential to transform the way software development currently occurs by allowing developers to receive valuable information and guidance in real time while they are participating in projects.


Learning reduced order models from data for hyperbolic PDEs. Given a set of solution snapshots of a hyperbolic PDE, we are interested in learning a reduced order model (ROM). To this end, we propose a novel decompose then learn approach. We decompose the solution by expressing it as a composition of a transformed solution and a de transformer. Our idea is to learn a ROM for both these objects, which, unlike the solution, are well approximable in a linear reduced space. A ROM for the (untransformed) solution is then recovered via a recomposition. The transformed solution results from composing the solution with a spatial transform that aligns the spatial discontinuities. Furthermore, the de transformer is the inverse of the spatial transform and lets us recover a ROM for the solution. We consider an image registration technique to compute the spatial transform, and to learn a ROM, we resort to the dynamic mode decomposition (DMD) methodology. Several benchmark problems demonstrate the effectiveness our method in representing the data and as a predictive tool.


Asymptotic stability of the 2D Boussinesq equations without thermal conduction. This paper is concerned with the asymptotic stability of certain stationary solution to Boussinesq equations without thermal conduction in the infinite flat strip Omega mathbb R times (0,1) . It is shown that the solution starting from initial data close to the stationary solution will converge to it with explicit algebraic rates as time tends to infinity.


Iterative Pseudo Labeling with Deep Feature Annotation and Confidence Based Sampling. Training deep neural networks is challenging when large and annotated datasets are unavailable. Extensive manual annotation of data samples is time consuming, expensive, and error prone, notably when it needs to be done by experts. To address this issue, increased attention has been devoted to techniques that propagate uncertain labels (also called pseudo labels) to large amounts of unsupervised samples and use them for training the model. However, these techniques still need hundreds of supervised samples per class in the training set and a validation set with extra supervised samples to tune the model. We improve a recent iterative pseudo labeling technique, Deep Feature Annotation (DeepFA), by selecting the most confident unsupervised samples to iteratively train a deep neural network. Our confidence based sampling strategy relies on only dozens of annotated training samples per class with no validation set, considerably reducing user effort in data annotation. We first ascertain the best configuration for the baseline a self trained deep neural network and then evaluate our confidence DeepFA for different confidence thresholds. Experiments on six datasets show that DeepFA already outperforms the self trained baseline, but confidence DeepFA can considerably outperform the original DeepFA and the baseline.


Quantum Fokker Planck Modeling of Degenerate Electrons. An implicit and conservative numerical scheme is proposed for the isotropic quantum Fokker Planck equation describing the evolution of degenerate electrons subject to elastic collisions with other electrons and ions. The electron ion and electron electron collision operators are discretized using a discontinuous Galerkin method, and the electron energy distribution is updated by an implicit time integration method. The numerical scheme is designed to satisfy all conservation laws exactly. Numerical tests and comparisons with other modeling approaches are shown to demonstrate the accuracy and conservation properties of the proposed method.


Large scale GPU based network analysis of the human T cell receptor repertoire. Understanding the structure of the human T cell receptor repertoire is a crucial precondition to understand the ability of the immune system to recognize and respond to antigens. T cells are often compared via the complementarity determining region 3 (CDR3) of their respective T cell receptor beta chains. Nevertheless, previous studies often simply compared if CDR3beta sequences were equal, while network theory studies were usually limited to several thousand sequences due to the high computational effort of constructing the network. To overcome that hurdle, we introduce the GPU based algorithm TCR NET to construct large scale CDR3beta similarity networks using model generated and empirical sequence data with up to 800,000 CDR3beta sequences on a normal computer for the first time. Using network analysis methods we study the structural properties of these networks and conclude that (i) the fraction of public TCRs depends on the size of the TCR repertoire, along with the exact (not unified) definition of "public" sequences, (ii) the TCR network is assortative with the average neighbor degree being proportional to the squareroot of the degree of a node and (iii) the repertoire is robust against losses of TCRs. Moreover, we analyze the networks of antigen specific TCRs for different antigen families and find differing clustering coefficients and assortativities. TCR NET offers better access to assess large scale TCR repertoire networks, opening the possibility to quantify their structure and quantitatively distinguish their ability to react to antigens, which we anticipate to become a useful tool in a time of increasingly large amounts of repertoire sequencing data becoming available.


Inverse of divergence and homogenization of compressible Navier Stokes equations in randomly perforated domains. We analyze behavior of weak solutions to compressible fluid flows in a bounded domain in mathbb R 3 , randomly perforated by tiny balls with random size. Assuming the radii of the balls scale like varepsilon alpha , alpha 3 , with varepsilon denoting the average distance between the balls, the problem homogenize with the same limiting equation. Our main contribution is a construction of the Bogovski u i operator, uniformly in varepsilon , without any assumptions on the minimal distance between the balls.


Engineering MultiQueues Fast Relaxed Concurrent Priority Queues. Priority queues with parallel access are an attractive data structure for applications like prioritized online scheduling, discrete event simulation, or greedy algorithms. However, a classical priority queue constitutes a severe bottleneck in this context, leading to very small throughput. Hence, there has been significant interest in concurrent priority queues with relaxed semantics. We investigate the complementary quality criteria rank error (how close are deleted elements to the global minimum) and delay (for each element x, how many elements with lower priority are deleted before x). In this paper, we introduce MultiQueues as a natural approach to relaxed priority queues based on multiple sequential priority queues. Their naturally high theoretical scalability is further enhanced by using three orthogonal ways of batching operations on the sequential queues. Experiments indicate that MultiQueues present a very good performance quality tradeoff and considerably outperform competing approaches in at least one of these aspects. We employ a seemingly paradoxical technique of "wait free locking" that might be of more general interest to convert sequential data structures to relaxed concurrent data structures.


Communication Efficient Sampling for Distributed Training of Graph Convolutional Networks. Training Graph Convolutional Networks (GCNs) is expensive as it needs to aggregate data recursively from neighboring nodes. To reduce the computation overhead, previous works have proposed various neighbor sampling methods that estimate the aggregation result based on a small number of sampled neighbors. Although these methods have successfully accelerated the training, they mainly focus on the single machine setting. As real world graphs are large, training GCNs in distributed systems is desirable. However, we found that the existing neighbor sampling methods do not work well in a distributed setting. Specifically, a naive implementation may incur a huge amount of communication of feature vectors among different machines. To address this problem, we propose a communication efficient neighbor sampling method in this work. Our main idea is to assign higher sampling probabilities to the local nodes so that remote nodes are accessed less frequently. We present an algorithm that determines the local sampling probabilities and makes sure our skewed neighbor sampling does not affect much the convergence of the training. Our experiments with node classification benchmarks show that our method significantly reduces the communication overhead for distributed GCN training with little accuracy loss.


Does Publicity in the Science Press Drive Citations?. We study how publicity in the science press, in the form of highlighting, affects the citations of research papers. Using multiple linear regression, we quantify the citation advantage associated with several highlighting platforms for papers published in Physical Review Letters (PRL) from 2008 2018. We thus find that the strongest predictor of citation accrual is a Viewpoint in Physics magazine, followed by a Research Highlight in Nature, an Editors' Suggestion in PRL, and a Research Highlight in Nature Physics. A similar hierarchical pattern is found when we search for extreme, not average, citation accrual, in the form a paper being listed among the top 1 cited papers in physics by Clarivate Analytics. The citation advantage of each highlighting platform is stratified according to the degree of vetting for importance that the manuscript received during peer review. This implies that we can view highlighting platforms as predictors of citation accrual, with varying degrees of strength that mirror each platform's vetting level.


Tawsol Symbols 3D Towards an innovative Picture Exchange Communication Systems PECS. Pictograms (also called symbols) are widely used in daily life as a type of visual language, such as transportation venue signs (airport, rail station, etc.), road signs, care symbols on clothing, or direction symbols (Tijus et al., 2007). This shows how symbols can communicate information quickly and effectively. Fundamentally, symbols can be understood, regardless of the person's language or literacy skills. Therefore, people with communication difficulties may benefit from using symbols to comprehend what other people are saying, as well as to express themselves. There are many sets of pictograms available online or in the market as printed cards, some of them are free and some must be purchased. Pictogram sets can be considered in several ways including how pictorial, how guessable, how flexible, how consistent, and how visually complex. Each symbol set has strengths and weaknesses, and the choice of a symbol set should be based on the needs and abilities of the person using AAC.


LPF A Language Prior Feedback Objective Function for De biased Visual Question Answering. Most existing Visual Question Answering (VQA) systems tend to overly rely on language bias and hence fail to reason from the visual clue. To address this issue, we propose a novel Language Prior Feedback (LPF) objective function, to re balance the proportion of each answer's loss value in the total VQA loss. The LPF firstly calculates a modulating factor to determine the language bias using a question only branch. Then, the LPF assigns a self adaptive weight to each training sample in the training process. With this reweighting mechanism, the LPF ensures that the total VQA loss can be reshaped to a more balanced form. By this means, the samples that require certain visual information to predict will be efficiently used during training. Our method is simple to implement, model agnostic, and end to end trainable. We conduct extensive experiments and the results show that the LPF (1) brings a significant improvement over various VQA models, (2) achieves competitive performance on the bias sensitive VQA CP v2 benchmark.


Persistence of Conley Morse Graphs in Combinatorial Dynamical Systems. Multivector fields provide an avenue for studying continuous dynamical systems in a combinatorial framework. There are currently two approaches in the literature which use persistent homology to capture changes in combinatorial dynamical systems. The first captures changes in the Conley index, while the second captures changes in the Morse decomposition. However, such approaches have limitations. The former approach only describes how the Conley index changes across a selected isolated invariant set though the dynamics can be much more complicated than the behavior of a single isolated invariant set. Likewise, considering a Morse decomposition omits much information about the individual Morse sets. In this paper, we propose a method to summarize changes in combinatorial dynamical systems by capturing changes in the so called Conley Morse graphs. A Conley Morse graph contains information about both the structure of a selected Morse decomposition and about the Conley index at each Morse set in the decomposition. Hence, our method summarizes the changing structure of a sequence of dynamical systems at a finer granularity than previous approaches.


A Queueing Theoretic Framework for Vehicle Dispatching in Dynamic Car Hailing technical report . With the rapid development of smart mobile devices, the car hailing platforms (e.g., Uber or Lyft) have attracted much attention from both the academia and the industry. In this paper, we consider an important dynamic car hailing problem, namely textit maximum revenue vehicle dispatching (MRVD), in which rider requests dynamically arrive and drivers need to serve as many riders as possible such that the entire revenue of the platform is maximized. We prove that the MRVD problem is NP hard and intractable. In addition, the dynamic car hailing platforms have no information of the future riders, which makes the problem even harder. To handle the MRVD problem, we propose a queueing based vehicle dispatching framework, which first uses existing machine learning algorithms to predict the future vehicle demand of each region, then estimates the idle time periods of drivers through a queueing model for each region. With the information of the predicted vehicle demands and estimated idle time periods of drivers, we propose two batch based vehicle dispatching algorithms to efficiently assign suitable drivers to riders such that the expected overall revenue of the platform is maximized during each batch processing. Through extensive experiments, we demonstrate the efficiency and effectiveness of our proposed approaches over both real and synthetic datasets.


Understanding the Role of Affect Dimensions in Detecting Emotions from Tweets A Multi task Approach. We propose VADEC, a multi task framework that exploits the correlation between the categorical and dimensional models of emotion representation for better subjectivity analysis. Focusing primarily on the effective detection of emotions from tweets, we jointly train multi label emotion classification and multi dimensional emotion regression, thereby utilizing the inter relatedness between the tasks. Co training especially helps in improving the performance of the classification task as we outperform the strongest baselines with 3.4 , 11 , and 3.9 gains in Jaccard Accuracy, Macro F1, and Micro F1 scores respectively on the AIT dataset. We also achieve state of the art results with 11.3 gains averaged over six different metrics on the SenWave dataset. For the regression task, VADEC, when trained with SenWave, achieves 7.6 and 16.5 gains in Pearson Correlation scores over the current state of the art on the EMOBANK dataset for the Valence (V) and Dominance (D) affect dimensions respectively. We conclude our work with a case study on COVID 19 tweets posted by Indians that further helps in establishing the efficacy of our proposed solution.


Low cost Stereovision system (disparity map) for few dollars. The paper presents an analysis of the latest developments in the field of stereo vision in the low cost segment, both for prototypes and for industrial designs. We described the theory of stereo vision and presented information about cameras and data transfer protocols and their compatibility with various devices. The theory in the field of image processing for stereo vision processes is considered and the calibration process is described in detail. Ultimately, we presented the developed stereo vision system and provided the main points that need to be considered when developing such systems. The final, we presented software for adjusting stereo vision parameters in real time in the python language in the Windows operating system.


Automatic digital twin data model generation of building energy systems from piping and instrumentation diagrams. Buildings directly and indirectly emit a large share of current CO2 emissions. There is a high potential for CO2 savings through modern control methods in building automation systems (BAS) like model predictive control (MPC). For a proper control, MPC needs mathematical models to predict the future behavior of the controlled system. For this purpose, digital twins of the building can be used. However, with current methods in existing buildings, a digital twin set up is usually labor intensive. Especially connecting the different components of the technical system to an overall digital twin of the building is time consuming. Piping and instrument diagrams (P ID) can provide the needed information, but it is necessary to extract the information and provide it in a standardized format to process it further. In this work, we present an approach to recognize symbols and connections of P ID from buildings in a completely automated way. There are various standards for graphical representation of symbols in P ID of building energy systems. Therefore, we use different data sources and standards to generate a holistic training data set. We apply algorithms for symbol recognition, line recognition and derivation of connections to the data sets. Furthermore, the result is exported to a format that provides semantics of building energy systems. The symbol recognition, line recognition and connection recognition show good results with an average precision of 93.7 , which can be used in further processes like control generation, (distributed) model predictive control or fault detection. Nevertheless, the approach needs further research.


Stability for the Erd H o s Rothschild problem. Given a sequence mathbf k (k 1, ldots,k s) of natural numbers and a graph G , let F(G mathbf k ) denote the number of colourings of the edges of G with colours 1, dots,s such that, for every c in 1, dots,s , the edges of colour c contain no clique of order k c . Write F(n mathbf k ) to denote the maximum of F(G mathbf k ) over all graphs G on n vertices. This problem was first considered by Erd H o s and Rothschild in 1974, but it has been solved only for a very small number of non trivial cases. In previous work with Yilma, we constructed a finite optimisation problem whose maximum is equal to the limit of log 2 F(n mathbf k ) n choose 2 as n tends to infinity and proved a stability theorem for complete multipartite graphs G . In this paper we provide a sufficient condition on mathbf k which guarantees a general stability theorem for any graph G , describing the asymptotic structure of G on n vertices with F(G mathbf k ) F(n mathbf k ) cdot 2 o(n 2) in terms of solutions to the optimisation problem. We apply our theorem to systematically recover existing stability results as well as all cases with s 2 . The proof uses a novel version of symmetrisation on edge coloured weighted multigraphs.


Ada SISE Adaptive Semantic Input Sampling for Efficient Explanation of Convolutional Neural Networks. Explainable AI (XAI) is an active research area to interpret a neural network's decision by ensuring transparency and trust in the task specified learned models. Recently, perturbation based model analysis has shown better interpretation, but backpropagation techniques are still prevailing because of their computational efficiency. In this work, we combine both approaches as a hybrid visual explanation algorithm and propose an efficient interpretation method for convolutional neural networks. Our method adaptively selects the most critical features that mainly contribute towards a prediction to probe the model by finding the activated features. Experimental results show that the proposed method can reduce the execution time up to 30 while enhancing competitive interpretability without compromising the quality of explanation generated.


A tight local algorithm for the minimum dominating set problem in outerplanar graphs. We show that there is a deterministic local algorithm (constant time distributed graph algorithm) that finds a 5 approximation of a minimum dominating set on outerplanar graphs. We show there is no such algorithm that finds a (5 varepsilon) approximation, for any varepsilon 0 . Our algorithm only requires knowledge of the degree of a vertex and of its neighbors, so that large messages and unique identifiers are not needed.


Unsupervised Deep Manifold Attributed Graph Embedding. Unsupervised attributed graph representation learning is challenging since both structural and feature information are required to be represented in the latent space. Existing methods concentrate on learning latent representation via reconstruction tasks, but cannot directly optimize representation and are prone to oversmoothing, thus limiting the applications on downstream tasks. To alleviate these issues, we propose a novel graph embedding framework named Deep Manifold Attributed Graph Embedding (DMAGE). A node to node geodesic similarity is proposed to compute the inter node similarity between the data space and the latent space and then use Bergman divergence as loss function to minimize the difference between them. We then design a new network structure with fewer aggregation to alleviate the oversmoothing problem and incorporate graph structure augmentation to improve the representation's stability. Our proposed DMAGE surpasses state of the art methods by a significant margin on three downstream tasks unsupervised visualization, node clustering, and link prediction across four popular datasets.


Information algebras in the theory of imprecise probabilities. In this paper, we show that coherent sets of gambles and coherent lower and upper previsions can be embedded into the algebraic structure of information algebra. This leads firstly, to a new perspective of the algebraic and logical structure of desirability and imprecise probabilities and secondly, it connects imprecise probabilities to other formalism in computer science sharing the same underlying structure. Both the domain free and the labeled view of the resulting information algebras are presented, considering product possibility spaces. Moreover, it is shown that both are atomistic and therefore they can be embedded in set algebras.


Counterexample Guided Repair for Symbolic Geometric Action Abstractions. Integrated Task and Motion Planning (TMP) provides a promising class of approaches for solving robot planning problems with intricate symbolic and geometric constraints. However, the practical usefulness of TMP planners is limited by their need for symbolic abstractions of robot actions, which are difficult to construct even for experts. We propose an approach to automatically construct and continuously improve a symbolic abstraction of a robot action via observations of the robot performing the action. This approach, called automatic abstraction repair, allows symbolic abstractions to be initially incorrect or incomplete and converge toward a correct model over time. Abstraction repair uses constrained polynomial zonotopes (CPZs), an efficient non convex set representation, to model predicates over joint symbolic and geometric state, and performs an optimizing search over symbolic edit operations to predicate formulae to improve the correspondence of a symbolic abstraction to the behavior of a physical robot controller. In this work, we describe the aforementioned predicate model, introduce the symbolic geometric abstraction repair problem, and present an anytime algorithm for automatic abstraction repair. We then demonstrate that abstraction repair can improve realistic action abstractions for common mobile manipulation actions from a handful of observations.


Adaptive Pad 'e Chebyshev Type Approximation of Piecewise Smooth Functions. A piecewise Pad 'e Chebyshev type (PiPCT) approximation method is proposed to minimize the Gibbs phenomenon in approximating piecewise smooth functions. A theorem on L 1 error estimate is proved for sufficiently smooth functions using a decay property of the Chebyshev coefficients. Numerical experiments are performed to show that the PiPCT method accurately captures isolated singularities of a function without using the positions and the types of singularities. Further, an adaptive partition approach to the PiPCT method is developed (referred to as the APiPCT method) to achieve the required accuracy with a lesser computational cost. Numerical experiments are performed to show some advantages of using the PiPCT and APiPCT methods compared to some well known methods in the literature.


ComicGAN Text to Comic Generative Adversarial Network. Drawing and annotating comic illustrations is a complex and difficult process. No existing machine learning algorithms have been developed to create comic illustrations based on descriptions of illustrations, or the dialogue in comics. Moreover, it is not known if a generative adversarial network (GAN) can generate original comics that correspond to the dialogue and or descriptions. GANs are successful in producing photo realistic images, but this technology does not necessarily translate to generation of flawless comics. What is more, comic evaluation is a prominent challenge as common metrics such as Inception Score will not perform comparably, as they are designed to work on photos. In this paper 1. We implement ComicGAN, a novel text to comic pipeline based on a text to image GAN that synthesizes comics according to text descriptions. 2. We describe an in depth empirical study of the technical difficulties of comic generation using GAN's. ComicGAN has two novel features (i) text description creation from labels via permutation and augmentation, and (ii) custom image encoding with Convolutional Neural Networks. We extensively evaluate the proposed ComicGAN in two scenarios, namely image generation from descriptions, and image generation from dialogue. Our results on 1000 Dilbert comic panels and 6000 descriptions show synthetic comic panels from text inputs resemble original Dilbert panels. Novel methods for text description creation and custom image encoding brought improvements to Frechet Inception Distance, detail, and overall image quality over baseline algorithms. Generating illustrations from descriptions provided clear comics including characters and colours that were specified in the descriptions.


Learning Robotic Manipulation Skills Using an Adaptive Force Impedance Action Space. Intelligent agents must be able to think fast and slow to perform elaborate manipulation tasks. Reinforcement Learning (RL) has led to many promising results on a range of challenging decision making tasks. However, in real world robotics, these methods still struggle, as they require large amounts of expensive interactions and have slow feedback loops. On the other hand, fast human like adaptive control methods can optimize complex robotic interactions, yet fail to integrate multimodal feedback needed for unstructured tasks. In this work, we propose to factor the learning problem in a hierarchical learning and adaption architecture to get the best of both worlds. The framework consists of two components, a slow reinforcement learning policy optimizing the task strategy given multimodal observations, and a fast, real time adaptive control policy continuously optimizing the motion, stability, and effort of the manipulator. We combine these components through a bio inspired action space that we call AFORCE. We demonstrate the new action space on a contact rich manipulation task on real hardware and evaluate its performance on three simulated manipulation tasks. Our experiments show that AFORCE drastically improves sample efficiency while reducing energy consumption and improving safety.


Gamma dose rate monitoring using a Silicon Photomultiplier based plastic scintillation detector. Plastic scintillation detectors represent an efficient, cost effective, customizable solution for assessment of gamma radiation fields in the context of nuclear security, environmental radiation survey, radiological and nuclear incidents response (RNe) and dosimetry for radiation protection purposes. Solid state light readout technologies such as Silicon Photomultiplier diodes (SiPM) are characterized by low operational voltage, mechanical robustness, compact dimensions, and fast pulse rise time. Due to these intrinsic advantages, Silicon Photomultiplier diodes have been progressively replacing Photomultiplier Tube based gamma detection technologies in a great part of these applications. In this experimental study, a gamma energy calibration and a dose rate calculation algorithm are discussed and implemented onto the SiPM based Flat Panel Gamma detector (FPG) developed by Arktis Radiation Detectors Ltd (Zurich, Switzerland). The FPG detector has been deployed and studied in the framework of research projects on RNe technologies, involving its use on unmanned aerial and ground vehicle such as drones and robots. This work moved from the need for end users to have an accurate and reliable dose rate assessment when operating in the field, especially in the context of RNe response. Results are presented in terms of gamma dose rate accuracy obtained by laboratory measurements using radionuclide sources emitting in the 0.059 1.333 MeV gamma energy range, compared to theoretical dose rate calculations.


Exact big Ramsey degrees via coding trees. We characterize the big Ramsey degrees of free amalgamation classes in finite binary languages defined by finitely many forbidden irreducible substructures, thus refining the recent upper bounds given by Zucker. Using this characterization, we show that the Fra "iss 'e limit of each such class admits a big Ramsey structure. Consequently, the automorphism group of each such Fra "iss 'e limit has a metrizable universal completion flow.


Towards Rotation Invariance in Object Detection. Rotation augmentations generally improve a model's invariance equivariance to rotation except in object detection. In object detection the shape is not known, therefore rotation creates a label ambiguity. We show that the de facto method for bounding box label rotation, the Largest Box Method, creates very large labels, leading to poor performance and in many cases worse performance than using no rotation at all. We propose a new method of rotation augmentation that can be implemented in a few lines of code. First, we create a differentiable approximation of label accuracy and show that axis aligning the bounding box around an ellipse is optimal. We then introduce Rotation Uncertainty (RU) Loss, allowing the model to adapt to the uncertainty of the labels. On five different datasets (including COCO, PascalVOC, and Transparent Object Bin Picking), this approach improves the rotational invariance of both one stage and two stage architectures when measured with AP, AP50, and AP75. The code is available at https github.com akasha imaging ICCV2021.


Learning Density Distribution of Reachable States for Autonomous Systems. State density distribution, in contrast to worst case reachability, can be leveraged for safety related problems to better quantify the likelihood of the risk for potentially hazardous situations. In this work, we propose a data driven method to compute the density distribution of reachable states for nonlinear and even black box systems. Our semi supervised approach learns system dynamics and the state density jointly from trajectory data, guided by the fact that the state density evolution follows the Liouville partial differential equation. With the help of neural network reachability tools, our approach can estimate the set of all possible future states as well as their density. Moreover, we could perform online safety verification with probability ranges for unsafe behaviors to occur. We use an extensive set of experiments to show that our learned solution can produce a much more accurate estimate on density distribution, and can quantify risks less conservatively and flexibly comparing with worst case analysis.