Formalizing the Face Lattice of Polyhedra. Faces play a central role in the combinatorial and computational aspects of polyhedra. In this paper, we present the first formalization of faces of polyhedra in the proof assistant Coq. This builds on the formalization of a library providing the basic constructions and operations over polyhedra, including projections, convex hulls and images under linear maps. Moreover, we design a special mechanism which automatically introduces an appropriate representation of a polyhedron or a face, depending on the context of the proof. We demonstrate the usability of this approach by establishing some of the most important combinatorial properties of faces, namely that they constitute a family of graded atomistic and coatomistic lattices closed under interval sublattices. We also prove a theorem due to Balinski on the d connectedness of the adjacency graph of polytopes of dimension d .


Endoscopic en face optical coherence tomography and fluorescence imaging using correlation based probe tracking. Forward viewing endoscopic optical coherence tomography (OCT) provides 3D imaging in vivo, and can be combined with widefield fluorescence imaging by use of a double clad fiber. However, it is technically challenging to build a high performance miniaturized 2D scanning system with a large field of view. In this paper we demonstrate how a 1D scanning probe, which produces cross sectional OCT images (B scans) and 1D fluorescence T scans, can be transformed into a 2D scanning probe by manual scanning along the second axis. OCT volumes are assembled from the B scans using speckle decorrelation measurements to estimate the out of plane motion along the manual scan direction. Motion within the plane of the B scans is corrected using image registration by normalized cross correlation. En face OCT slices and fluorescence images, corrected for probe motion in 3D, can be displayed in real time during the scan. For a B scan frame rate of 250 Hz, and an OCT lateral resolution of approximately 20 micrometers, the approach can handle out of plane motion at speeds of up to 4 mm s.


Convergence and stability of the semi tamed Milstein method for commutative stochastic differential equations with non globally Lipschitz continuous coefficients. A new explicit stochastic scheme of order 1 is proposed for solving commutative stochastic differential equations (SDEs) with non globally Lipschitz continuous coefficients. The proposed method is a semi tamed version of Milstein scheme to solve SDEs with the drift coefficient consisting of non Lipschitz continuous term and globally Lipschitz continuous term. It is easily implementable and achieves higher strong convergence order. A stability criterion for this method is derived, which shows that the stability condition of the numerical methods and that of the solved equations keep uniform. Compared with some widely used numerical schemes, the proposed method has better performance in inheriting the mean square stability of the exact solution of SDEs. Numerical experiments are given to illustrate the obtained convergence and stability properties.


Peering Beyond the Gradient Veil with Distributed Auto Differentiation. Although distributed machine learning has opened up many new and exciting research frontiers, fragmentation of models and data across different machines, nodes, and sites still results in considerable communication overhead, impeding reliable training in real world contexts. The focus on gradients as the primary shared statistic during training has spawned a number of intuitive algorithms for distributed deep learning however, gradient centric training of large deep neural networks (DNNs) tends to be communication heavy, often requiring additional adaptations such as sparsity constraints, compression, quantization, and more, to curtail bandwidth. We introduce an innovative, communication friendly approach for training distributed DNNs, which capitalizes on the outer product structure of the gradient as revealed by the mechanics of auto differentiation. The exposed structure of the gradient evokes a new class of distributed learning algorithm, which is naturally more communication efficient than full gradient sharing. Our approach, called distributed auto differentiation (dAD), builds off a marriage of rank based compression and the innate structure of the gradient as an outer product. We demonstrate that dAD trains more efficiently than other state of the art distributed methods on modern architectures, such as transformers, when applied to large scale text and imaging datasets. The future of distributed learning, we determine, need not be dominated by gradient centric algorithms.


Fixpoint Semantics for Recursive SHACL. SHACL is a W3C proposed language for expressing structural constraints on RDF graphs. The recommendation only specifies semantics for non recursive SHACL recently, some efforts have been made to allow recursive SHACL schemas. In this paper, we argue that for defining and studying semantics of recursive SHACL, lessons can be learned from years of research in non monotonic reasoning. We show that from a SHACL schema, a three valued semantic operator can directly be obtained. Building on Approximation Fixpoint Theory (AFT), this operator immediately induces a wide variety of semantics, including a supported, stable, and well founded semantics, related in the expected ways. By building on AFT, a rich body of theoretical results becomes directly available for SHACL. As such, the main contribution of this short paper is providing theoretical foundations for the study of recursive SHACL, which can later enable an informed decision for an extension of the W3C recommendation.


Feedback theory approach to positivity and stability of evolution equations. In this paper, we study the positivity and (uniform) exponential stability of a large class of perturbed semigroups. Our approach is essentially based on the feedback theory of infinite dimensional linear systems. The obtained results are applied to the stability of hyperbolic systems including those with a delay at the boundary conditions.


Bicolored tilings and the Scott map. We define bicolored tilings as a disk with a collection of smooth curves with a coloring map on the tiles that these curves delimit. Using two transformations, we define an equivalence on tilings. We then define the Scott map which creates a bijection between a generalised version of Postnikov diagrams and bicolored tilings, preserving equivalences, and mapping the geometric exchange of a diagram to an edge flip in a tiling.


Erasures repair for decreasing monomial Cartesian and augmented Reed Muller codes of high rate. In this work, we present linear exact repair schemes for one or two erasures in decreasing monomial Cartesian codes DM CC, a family of codes which provides a framework for polar codes. In the case of two erasures, the positions of the erasures should satisfy a certain restriction. We present families of augmented Reed Muller (ARM) and augmented Cartesian codes (ACar) which are families of evaluation codes obtained by strategically adding vectors to Reed Muller and Cartesian codes, respectively. We develop repair schemes for one or two erasures for these families of augmented codes. Unlike the repair scheme for two erasures of DM CC, the repair scheme for two erasures for the augmented codes has no restrictions on the positions of the erasures. When the dimension and base field are fixed, we give examples where ARM and ACar codes provide a lower bandwidth (resp., bitwidth) in comparison with Reed Solomon (resp., Hermitian) codes. When the length and base field are fixed, we give examples where ACar codes provide a lower bandwidth in comparison with ARM. Finally, we analyze the asymptotic behavior when the augmented codes achieve the maximum rate.


A Unified Convergence Analysis of a Second Order Method of Multipliers for Nonlinear Conic Programming. In this paper, we accomplish a unified convergence analysis of a second order method of multipliers (i.e., a second order augmented Lagrangian method) for solving the conventional nonlinear conic optimization problems.Specifically, the algorithm that we investigated incorporates a specially designed nonsmooth (generalized) Newton step to furnish a second order update rule for the multipliers.We first show in a unified fashion that under a few abstract assumptions, the proposed method is locally convergent and possesses a (nonasymptotic) superlinear convergence rate, even though the penalty parameter is fixed and or the strict complementarity fails.Subsequently, we demonstrate that, for the three typical scenarios, i.e., the classic nonlinear programming, the nonlinear second order cone programming, and the nonlinear semidefinite programming, these abstract assumptions are nothing but exactly the implications of the iconic sufficient conditions that were assumed for establishing the Q linear convergence rates of the method of multipliers without assuming the strict complementarity.


On generalized Iwasawa main conjectures and p adic Stark conjectures for Artin motives. We formulate a cyclotomic main conjecture and an extra zeros conjecture for general p stabilized Artin representations, which are shown to imply the p part of the Tamagawa number conjecture for Artin motives at s 0 . We also relate our new conjectures with various Iwasawa main conjectures and p adic Stark conjectures that appear in the literature. In the case of monomial representations, we prove that our conjectures are essentially equivalent to some newly introduced Iwasawa theoretic conjectures for Rubin Stark elements. Along the way, we study the Gross Kuz'min conjecture from the viewpoint of p adic transcendence theory and we show that it unconditionally holds for abelian extensions of imaginary quadratic fields.


Transfer Learning based Speech Affect Recognition in Urdu. It has been established that Speech Affect Recognition for low resource languages is a difficult task. Here we present a Transfer learning based Speech Affect Recognition approach in which we pre train a model for high resource language affect recognition task and fine tune the parameters for low resource language using Deep Residual Network. Here we use standard four data sets to demonstrate that transfer learning can solve the problem of data scarcity for Affect Recognition task. We demonstrate that our approach is efficient by achieving 74.7 percent UAR on RAVDESS as source and Urdu data set as a target. Through an ablation study, we have identified that pre trained model adds most of the features information, improvement in results and solves less data issues. Using this knowledge, we have also experimented on SAVEE and EMO DB data set by setting Urdu as target language where only 400 utterances of data is available. This approach achieves high Unweighted Average Recall (UAR) when compared with existing algorithms.


The number of solutions of diagonal cubic equations over finite fields. Let mathbb F q be a finite field of q p k elements. For any z in mathbb F q , let A n(z) and B n(z) denote the number of solutions of the equations x 1 3 x 2 3 cdots x n 3 z and x 1 3 x 2 3 cdots x n 3 zx n 1 3 0 respectively. Recently, using the generator of mathbb F ast q , Hong and Zhu gave the generating functions sum n 1 infty A n(z)x n and sum n 1 infty B n(z)x n . In this paper, we give the generating functions sum n 1 infty A n(z)x n and sum n 1 infty B n(z)x n immediately by the coefficient z . Moreover, we gave the formulas of the number of solutions of equation a 1x 1 3 a 2x 2 3 a 3x 3 3 0 and our formulas are immediately determined by the coefficients a 1,a 2 and a 3 . These extend and improve earlier results.


Subresultant of several univariate polynomials. Subresultant of two univariate polynomials is a fundamental object in computational algebra and geometry with many applications (for instance, parametric GCD and parametric multiplicity of roots). In this paper, we generalize the theory of subresultants of two polynomials to arbitrary number of polynomials, resulting in multi polynomial subresultants. Specifically, 1. we propose a definition of multi polynomial subresultants, which is an expression in terms of roots 2. we illustrate the usefulness of the proposed definition via the following two fundamental applications parametric GCD of multi polynomials, and parametric multiplicity of roots of a polynomial 3. we provide several expressions for the multi polynomials subresultants in terms of coefficients, for computation.


Symmetry aware Neural Architecture for Embodied Visual Navigation. Visual exploration is a task that seeks to visit all the navigable areas of an environment as quickly as possible. The existing methods employ deep reinforcement learning (RL) as the standard tool for the task. However, they tend to be vulnerable to statistical shifts between the training and test data, resulting in poor generalization over novel environments that are out of distribution (OOD) from the training data. In this paper, we attempt to improve the generalization ability by utilizing the inductive biases available for the task. Employing the active neural SLAM (ANS) that learns exploration policies with the advantage actor critic (A2C) method as the base framework, we first point out that the mappings represented by the actor and the critic should satisfy specific symmetries. We then propose a network design for the actor and the critic to inherently attain these symmetries. Specifically, we use G convolution instead of the standard convolution and insert the semi global polar pooling (SGPP) layer, which we newly design in this study, in the last section of the critic network. Experimental results show that our method increases area coverage by 8.1 m 2 when trained on the Gibson dataset and tested on the MP3D dataset, establishing the new state of the art.


Fake News Detection Tools and Methods A Review. In the past decade, the social networks platforms and micro blogging sites such as Facebook, Twitter, Instagram, and Weibo have become an integral part of our day to day activities and is widely used all over the world by billions of users to share their views and circulate information in the form of messages, pictures, and videos. These are even used by government agencies to spread important information through their verified Facebook accounts and official Twitter handles, as they can reach a huge population within a limited time window. However, many deceptive activities like propaganda and rumor can mislead users on a daily basis. In these COVID times, fake news and rumors are very prevalent and are shared in a huge number which has created chaos in this tough time. And hence, the need for Fake News Detection in the present scenario is inevitable. In this paper, we survey the recent literature about different approaches to detect fake news over the Internet. In particular, we firstly discuss fake news and the various terms related to it that have been considered in the literature. Secondly, we highlight the various publicly available datasets and various online tools that are available and can debunk Fake News in real time. Thirdly, we describe fake news detection methods based on two broader areas i.e., its content and the social context. Finally, we provide a comparison of various techniques that are used to debunk fake news.


DEHB Evolutionary Hyperband for Scalable, Robust and Efficient Hyperparameter Optimization. Modern machine learning algorithms crucially rely on several design decisions to achieve strong performance, making the problem of Hyperparameter Optimization (HPO) more important than ever. Here, we combine the advantages of the popular bandit based HPO method Hyperband (HB) and the evolutionary search approach of Differential Evolution (DE) to yield a new HPO method which we call DEHB. Comprehensive results on a very broad range of HPO problems, as well as a wide range of tabular benchmarks from neural architecture search, demonstrate that DEHB achieves strong performance far more robustly than all previous HPO methods we are aware of, especially for high dimensional problems with discrete input dimensions. For example, DEHB is up to 1000x faster than random search. It is also efficient in computational time, conceptually simple and easy to implement, positioning it well to become a new default HPO method.


A new theory of the coefficient of earth pressure at rest. One of the well known and widely applied parameters in soil mechanics is the so called coefficient of earth pressure at rest (denoted by a K0). Field and laboratory investigations show that this parameter is correlated with the friction angle and the overconsolidation ratio of the soil deposit. For normally consolidated clays, the semi emprical expression developed by Jaky is considered to hold good. The extension of Jaky's equation for overconsolidated soils is built entirely on empirical data and there is lack of a theoretical framework that satisfactorily explains the relationships. In this paper, these relationships are investigated from the nature of energy dissipation of soil aggregates. For the same, the cyclic stress dilatancy relationship proposed by the author is employed, here for a plane strain condition. Then, the relationship between the stress ratio and the mobilized friction angle that maximizes the plastic dissipation is obtained the value of the stress ratio at this state is shown to be reasonably close to the relationship proposed by Jaky. An exponential relationship between K0 and OCR is derived, and for a special case, the exponent is shown to be the sine of the critical state friction angle. Finally, some generalizations are given and aspects which need further investigation are highlighted.


On the clique behavior of graphs of low degree. To any simple graph G , the clique graph operator K associates the graph K(G) which is the intersection graph of the maximal complete subgraphs of G . The iterated clique graphs are defined by K 0 (G) G and K n (G) K(K n 1 (G)) for n geq 1 . If there are m n such that K m (G) is isomorphic to K n (G) we say that G is convergent, otherwise, G is divergent. The first example of a divergent graph was shown by Neumann Lara in the 1970s, and is the graph of the octahedron. In this paper, we prove that among the connected graphs with maximum degree 4, the octahedron is the only one that is divergent.


Higher order exceptional point and Landau Zener Bloch oscillations in driven non Hermitian photonic Lieb lattices. We propose a scheme to realize parity time (PT) symmetric photonic Lieb lattices of ribbon shape and complex couplings, thereby demonstrating the higher order exceptional point (EP) and Landau Zener Bloch (LZB) oscillations in presence of a refractive index gradient. Quite different from non Hermitian flatband lattices with on site gain loss, which undergo thresholdless PT symmetry breaking, the spectrum for such quasi one dimensional Lieb lattices has completely real values when the index gradient is applied perpendicular to the ribbon, and a triply degenerated (third order) EP with coalesced eigenvalues and eigenvectors emerges only when the amplitude of gain loss ratio reaches a certain threshold value. When the index gradient is applied parallel to the ribbon, the LZB oscillations exhibit intriguing characteristics including asymmetric energy transition and pseudo Hermitian propagation as the flatband is excited. Meanwhile, a secondary emission occurs each time when the oscillatory motion passes through the EP, leading to distinct energy distribution in the flatband when a dispersive band is excited. Such novel phenomena may appear in other non Hermitian flatband systems. Our work may also bring insight and suggest a photonic platform to study the symmetry and topological characterization of higher order EPs that may find unique applications in for example enhancing sensitivity.


End to End Semi Supervised Object Detection with Soft Teacher. This paper presents an end to end semi supervised object detection approach, in contrast to previous more complex multi stage methods. The end to end training gradually improves pseudo label qualities during the curriculum, and the more and more accurate pseudo labels in turn benefit object detection training. We also propose two simple yet effective techniques within this framework a soft teacher mechanism where the classification loss of each unlabeled bounding box is weighed by the classification score produced by the teacher network a box jittering approach to select reliable pseudo boxes for the learning of box regression. On the COCO benchmark, the proposed approach outperforms previous methods by a large margin under various labeling ratios, i.e. 1 , 5 and 10 . Moreover, our approach proves to perform also well when the amount of labeled data is relatively large. For example, it can improve a 40.9 mAP baseline detector trained using the full COCO training set by 3.6 mAP, reaching 44.5 mAP, by leveraging the 123K unlabeled images of COCO. On the state of the art Swin Transformer based object detector (58.9 mAP on test dev), it can still significantly improve the detection accuracy by 1.5 mAP, reaching 60.4 mAP, and improve the instance segmentation accuracy by 1.2 mAP, reaching 52.4 mAP. Further incorporating with the Object365 pre trained model, the detection accuracy reaches 61.3 mAP and the instance segmentation accuracy reaches 53.0 mAP, pushing the new state of the art.


Learning to Anticipate Egocentric Actions by Imagination. Anticipating actions before they are executed is crucial for a wide range of practical applications, including autonomous driving and robotics. In this paper, we study the egocentric action anticipation task, which predicts future action seconds before it is performed for egocentric videos. Previous approaches focus on summarizing the observed content and directly predicting future action based on past observations. We believe it would benefit the action anticipation if we could mine some cues to compensate for the missing information of the unobserved frames. We then propose to decompose the action anticipation into a series of future feature predictions. We imagine how the visual feature changes in the near future and then predicts future action labels based on these imagined representations. Differently, our ImagineRNN is optimized in a contrastive learning way instead of feature regression. We utilize a proxy task to train the ImagineRNN, i.e., selecting the correct future states from distractors. We further improve ImagineRNN by residual anticipation, i.e., changing its target to predicting the feature difference of adjacent frames instead of the frame content. This promotes the network to focus on our target, i.e., the future action, as the difference between adjacent frame features is more important for forecasting the future. Extensive experiments on two large scale egocentric action datasets validate the effectiveness of our method. Our method significantly outperforms previous methods on both the seen test set and the unseen test set of the EPIC Kitchens Action Anticipation Challenge.


Markpainting Adversarial Machine Learning meets Inpainting. Inpainting is a learned interpolation technique that is based on generative modeling and used to populate masked or missing pieces in an image it has wide applications in picture editing and retouching. Recently, inpainting started being used for watermark removal, raising concerns. In this paper we study how to manipulate it using our markpainting technique. First, we show how an image owner with access to an inpainting model can augment their image in such a way that any attempt to edit it using that model will add arbitrary visible information. We find that we can target multiple different models simultaneously with our technique. This can be designed to reconstitute a watermark if the editor had been trying to remove it. Second, we show that our markpainting technique is transferable to models that have different architectures or were trained on different datasets, so watermarks created using it are difficult for adversaries to remove. Markpainting is novel and can be used as a manipulation alarm that becomes visible in the event of inpainting.


Classification of divisible design graphs with at most 39 vertices. A k regular graph is called a divisible design graph (DDG for short) if its vertex set can be partitioned into m classes of size n , such that two distinct vertices from the same class have exactly lambda 1 common neighbors, and two vertices from different classes have exactly lambda 2 common neighbors. A DDG with m 1 , n 1 , or lambda 1 lambda 2 is called improper, otherwise it is called proper. We present new constructions of DDGs and, using a computer enumeration algorithm, we find all proper connected DDGs with at most 39 vertices, except for three tuples of parameters (32,15,6,7,4,8) , (32,17,8,9,4,8) , (36,24,15,16,4,9) .


EvoLearner Learning Description Logics with Evolutionary Algorithms. Classifying nodes in knowledge graphs is an important task, e.g., for predicting missing types of entities, predicting which molecules cause cancer, or predicting which drugs are promising treatment candidates. While black box models often achieve high predictive performance, they are only post hoc and locally explainable and do not allow the learned model to be easily enriched with domain knowledge. Towards this end, learning description logic concepts from positive and negative examples has been proposed. However, learning such concepts often takes a long time and state of the art approaches provide limited support for literal data values, although they are crucial for many applications. In this paper, we propose EvoLearner an evolutionary approach to learn concepts in ALCQ(D), which is the attributive language with complement (ALC) paired with qualified cardinality restrictions (Q) and data properties (D). We contribute a novel initialization method for the initial population starting from positive examples, we perform biased random walks and translate them to description logic concepts. Moreover, we improve support for data properties by maximizing information gain when deciding where to split the data. We show that our approach significantly outperforms the state of the art on the benchmarking framework SML Bench for structured machine learning. Our ablation study confirms that this is due to our novel initialization method and support for data properties.


Semantic Table Retrieval using Keyword and Table Queries. Tables on the Web contain a vast amount of knowledge in a structured form. To tap into this valuable resource, we address the problem of table retrieval answering an information need with a ranked list of tables. We investigate this problem in two different variants, based on how the information need is expressed as a keyword query or as an existing table ("query by table"). The main novel contribution of this work is a semantic table retrieval framework for matching information needs (keyword or table queries) against tables. Specifically, we (i) represent queries and tables in multiple semantic spaces (both discrete sparse and continuous dense vector representations) and (ii) introduce various similarity measures for matching those semantic representations. We consider all possible combinations of semantic representations and similarity measures and use these as features in a supervised learning model. Using two purpose built test collections based on Wikipedia tables, we demonstrate significant and substantial improvements over state of the art baselines.


Nonlinear Evolutionary PDE Based Refinement of Optical Flow. The goal of this paper is to propose two nonlinear variational models for obtaining a refined motion estimation from an image sequence. Both the proposed models can be considered as a part of a generalized framework for an accurate estimation of physics based flow fields such as rotational and fluid flow. The first model is novel in the sense that it is divided into two phases the first phase obtains a crude estimate of the optical flow and then the second phase refines this estimate using additional constraints. The correctness of this model is proved using an evolutionary PDE approach. The second model achieves the same refinement as the first model, but in a standard manner, using a single functional. A special feature of our models is that they permit us to provide efficient numerical implementations through the first order primal dual Chambolle Pock scheme. Both the models are compared in the context of accurate estimation of angle by performing an anisotropic regularization of the divergence and curl of the flow respectively. We observe that, although both the models obtain the same level of accuracy, the two phase model is more efficient. In fact, we empirically demonstrate that the single phase and the two phase models have convergence rates of order O(1 N 2) and O(1 N) respectively.


Contrastive Learning for Recommender System. Recommender systems, which analyze users' preference patterns to suggest potential targets, are indispensable in today's society. Collaborative Filtering (CF) is the most popular recommendation model. Specifically, Graph Neural Network (GNN) has become a new state of the art for CF. In the GNN based recommender system, message dropout is usually used to alleviate the selection bias in the user item bipartite graph. However, message dropout might deteriorate the recommender system's performance due to the randomness of dropping out the outgoing messages based on the user item bipartite graph. To solve this problem, we propose a graph contrastive learning module for a general recommender system that learns the embeddings in a self supervised manner and reduces the randomness of message dropout. Besides, many recommender systems optimize models with pairwise ranking objectives, such as the Bayesian Pairwise Ranking (BPR) based on a negative sampling strategy. However, BPR has the following problems suboptimal sampling and sample bias. We introduce a new debiased contrastive loss to solve these problems, which provides sufficient negative samples and applies a bias correction probability to alleviate the sample bias. We integrate the proposed framework, including graph contrastive module and debiased contrastive module with several Matrix Factorization(MF) and GNN based recommendation models. Experimental results on three public benchmarks demonstrate the effectiveness of our framework.


Discrete Distribution Estimation with Local Differential Privacy A Comparative Analysis. Local differential privacy is a promising privacy preserving model for statistical aggregation of user data that prevents user privacy leakage from the data aggregator. This paper focuses on the problem of estimating the distribution of discrete user values with Local differential privacy. We review and present a comparative analysis on the performance of the existing discrete distribution estimation algorithms in terms of their accuracy on benchmark datasets. Our evaluation benchmarks include real world and synthetic datasets of categorical individual values with the number of individuals from hundreds to millions and the domain size up to a few hundreds of values. The experimental results show that the Basic RAPPOR algorithm generally performs best for the benchmark datasets in the high privacy regime while the k RR algorithm often gives the best estimation in the low privacy regime. In the medium privacy regime, the performance of the k RR, the k subset, and the HR algorithms are fairly competitive with each other and generally better than the performance of the Basic RAPPOR and the CMS algorithms.


Holographic beam shaping of partially coherent light. We present an algorithm for holographic shaping of partially coherent light, bridging the gap between traditional coherent and geometric optical approaches. The description of partially coherent light relies on a mode expansion formalism, with possibly thousands of individual modes, and the inverse design optimization algorithm is based on gradient descent with the help of algorithmic differentiation. We demonstrate numerically and experimentally that an optical system consisting of two phase patterns can potentially achieve any intensity profile transformation with good accuracy.


Learnt Sparsification for Interpretable Graph Neural Networks. Graph neural networks (GNNs) have achieved great success on various tasks and fields that require relational modeling. GNNs aggregate node features using the graph structure as inductive biases resulting in flexible and powerful models. However, GNNs remain hard to interpret as the interplay between node features and graph structure is only implicitly learned. In this paper, we propose a novel method called Kedge for explicitly sparsifying the underlying graph by removing unnecessary neighbors. Our key idea is based on a tractable method for sparsification using the Hard Kumaraswamy distribution that can be used in conjugation with any GNN model. Kedge learns edge masks in a modular fashion trained with any GNN allowing for gradient based optimization in an end to end fashion. We demonstrate through extensive experiments that our model Kedge can prune a large proportion of the edges with only a minor effect on the test accuracy. Specifically, in the PubMed dataset, Kedge learns to drop more than 80 of the edges with an accuracy drop of merely 2 showing that graph structure has only a small contribution in comparison to node features. Finally, we also show that Kedge effectively counters the over smoothing phenomena in deep GNNs by maintaining good task performance with increasing GNN layers.


Secure Precoding in MIMO NOMA A Deep Learning Approach. A novel signaling design for secure transmission over two user multiple input multiple output non orthogonal multiple access channel using deep neural networks (DNNs) is proposed. The goal of the DNN is to form the covariance matrix of users' signals such that the message of each user is transmitted reliably while being confidential from its counterpart. The proposed DNN linearly precodes each user's signal before superimposing them and achieves near optimal performance with significantly lower run time. Simulation results show that the proposed models reach about 98 of the secrecy capacity rates. The spectral efficiency of the DNN precoder is much higher than that of existing analytical linear precoders e.g., generalized singular value decomposition and its on the fly complexity is several times less than the existing iterative methods.


FisherMob a bioeconomic model of fishers' migrations. Sea fishing is a highly mobile activity, favoured by the vastness of the oceans, the absence of physical boundaries and the abstraction of legislative boundaries. Understanding and anticipating this mobility is a major challenge for fisheries management issues, both at the national and international levels. ''FisherMob'' is a free Gama tool designed to study the effect of economic and biological factors on the dynamics of connected fisheries. It incorporate the most important processes involved in fisheries dynamics fish abundance variability, price of the fishing effort and ex vessel fish market price that which depends on the ratio between offer and demand. The tool uses as input a scheme of a coastal area with delimited fishing sites, fish biological parameters and fisheries parameters. It runs with a userfriendly graphic interface and generates output files that can be post processed easily using graphic and statistical software.


Offline Reinforcement Learning with Value based Episodic Memory. Offline reinforcement learning (RL) shows promise of applying RL to real world problems by effectively utilizing previously collected data. Most existing offline RL algorithms use regularization or constraints to suppress extrapolation error for actions outside the dataset. In this paper, we adopt a different framework, which learns the V function instead of the Q function to naturally keep the learning procedure within the support of an offline dataset. To enable effective generalization while maintaining proper conservatism in offline learning, we propose Expectile V Learning (EVL), which smoothly interpolates between the optimal value learning and behavior cloning. Further, we introduce implicit planning along offline trajectories to enhance learned V values and accelerate convergence. Together, we present a new offline method called Value based Episodic Memory (VEM). We provide theoretical analysis for the convergence properties of our proposed VEM method, and empirical results in the D4RL benchmark show that our method achieves superior performance in most tasks, particularly in sparse reward tasks.


Describing, modelling and forecasting the spatial and temporal spread of COVID 19 A short review. SARS CoV 2 started propagating worldwide in January 2020 and has now reached virtually all communities on the planet. This short review provides evidence of this spread and documents modelling efforts undertaken to understand and forecast it, including a short section about the new variants that emerged in late 2020.


Bicriteria Nash Flows over Time. Flows over time are a natural way to incorporate flow dynamics that arise in various applications such as traffic networks. In this paper we introduce a natural variant of the deterministic fluid queuing model in which users aim to minimize their costs subject to arrival at their destination before a pre specified deadline. We determine the existence and the structure of Nash flows over time and fully characterize the price of anarchy for this model. The price of anarchy measures the ratio of the quality of the equilibrium and the quality of the optimum flow, where we evaluate the quality using two different natural performance measures the throughput for a given deadline and the makespan for a given amount of flow. While it turns out that both prices of anarchy can be unbounded in general, we provide tight bounds for the important subclass of parallel path networks. Surprisingly, the two performance measures yield different results here.


Learning High Dimensional Wasserstein Geodesics. We propose a new formulation and learning strategy for computing the Wasserstein geodesic between two probability distributions in high dimensions. By applying the method of Lagrange multipliers to the dynamic formulation of the optimal transport (OT) problem, we derive a minimax problem whose saddle point is the Wasserstein geodesic. We then parametrize the functions by deep neural networks and design a sample based bidirectional learning algorithm for training. The trained networks enable sampling from the Wasserstein geodesic. As by products, the algorithm also computes the Wasserstein distance and OT map between the marginal distributions. We demonstrate the performance of our algorithms through a series of experiments with both synthetic and realistic data.


A multi plane augmented reality head up display system based on volume holographic optical elements with large area. The traditional head up display (HUD) system has the disadvantages of a small area and a single display plane, here we propose and design an augmented reality (AR) HUD system with multi plane, large area, high diffraction efficiency and a single picture generation unit (PGU) based on holographic optical elements (HOEs). Since volume HOEs have excellent angle selectivity and wavelength selectivity, HOEs of different wavelengths can be designed to display images in different planes. Experimental and simulated results verify the feasibility of this method. Experimental results show that the diffraction efficiencies of the red, green and blue HOEs are 75.2 , 73.1 and 67.5 . And the size of HOEs is 20cm 15cm. Moreover, the three HOEs of red, green and blue display images at different depths of 150cm, 500cm and 1000cm, respectively. In addition, the field of view (FOV) and eye box (EB) of the system are 12 deg 10 deg and 9.5cm 11.2cm. Furthermore, the light transmittance of the system has reached 60 . It is believed that this technique can be applied to the augmented reality navigation display of vehicles and aviation.


The history and future prospects of open data and open source software. Open data for all New Yorkers is the tagline on New York City's open data website. Open government is being promoted at most countries of the western world. Government transparency levels are being measured by the amount of data they share through their online public repositories. Additionally, open source software is promoted at governments, academia, and the industry. This is the new digital story of this century, and the new testament between the Gods of technology and there users. Data and software openness will redefine the path forward and aim to rekindle our collective intelligence. Data and software openness can redefine Data Democracy and be the catalyst for its progress. This chapter provides a historical insight into data and software openness, the beginnings, the heroes, prospects for the future, and all things we cannot afford to negotiate or lose.


Steady state joint distribution for first order stochastic reaction kinetics. While the analytical solution for the marginal distribution of a stochastic chemical reaction network has been extensively studied, its joint distribution, i.e. the solution of a high dimensional chemical master equation, has received much less attention. Here we develop a novel method of computing the exact joint distributions of a wide class of first order stochastic reaction systems in steady state conditions. The effectiveness of our method is validated by applying it to four gene expression models of biological significance, including models with 2A peptides, nascent mRNA, gene regulation, translational bursting, and alternative splicing.


Active Learning for Massively Parallel Translation of Constrained Text into Low Resource Languages. We translate a closed text that is known in advance and available in many languages into a new and severely low resource language. Most human translation efforts adopt a portion based approach to translate consecutive pages chapters in order, which may not suit machine translation. We compare the portion based approach that optimizes coherence of the text locally with the random sampling approach that increases coverage of the text globally. Our results show that the random sampling approach performs better. When training on a seed corpus of 1,000 lines from the Bible and testing on the rest of the Bible ( 30,000 lines), random sampling gives a performance gain of 11.0 BLEU using English as a simulated low resource language, and 4.9 BLEU using Eastern Pokomchi, a Mayan language. Furthermore, we compare three ways of updating machine translation models with increasing amount of human post edited data through iterations. We find that adding newly post edited data to training after vocabulary update without self supervision performs the best. We propose an algorithm for human and machine to work together seamlessly to translate a closed text into a severely low resource language.


How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding. Knowledge Distillation (KD) is a model compression algorithm that helps transfer the knowledge of a large neural network into a smaller one. Even though KD has shown promise on a wide range of Natural Language Processing (NLP) applications, little is understood about how one KD algorithm compares to another and whether these approaches can be complimentary to each other. In this work, we evaluate various KD algorithms on in domain, out of domain and adversarial testing. We propose a framework to assess the adversarial robustness of multiple KD algorithms. Moreover, we introduce a new KD algorithm, Combined KD, which takes advantage of two promising approaches (better training scheme and more efficient data augmentation). Our extensive experimental results show that Combined KD achieves state of the art results on the GLUE benchmark, out of domain generalization, and adversarial robustness compared to competitive methods.


Einstein Lie groups, geodesic orbit manifolds and regular Lie subgroups. We study the relation between two special classes of Riemannian Lie groups G with a left invariant metric g The Einstein Lie groups, defined by the condition operatorname Ric g cg , and the geodesic orbit Lie groups, defined by the property that any geodesic is the integral curve of a Killing vector field. The main results imply that extensive classes of compact simple Einstein Lie groups (G,g) are not geodesic orbit manifolds, thus providing large scale answers to a relevant open question of Y. Nikonorov. Our approach involves studying and characterizing the G times K invariant geodesic orbit metrics on Lie groups G , where K are certain closed subgroups of G . A key ingredient of our study is the favorable representation theoretic behaviour of a wide class of subgroups K that we call (weakly) regular. By products of our work are structural and characterization results that are of independent interest for the classification problem of geodesic orbit manifolds.


Operating Principles of Peristaltic Pumping through a Dense Array of Valves. Immersed nonlinear elements are prevalent in biological systems that require a preferential flow direction. A certain class of models is investigated where the fluid is driven by peristaltic pumping and the nonlinear elements are ideal valves that completely suppress backflow. This highly nonlinear system produces discontinuous solutions that are difficult to study. As the density of valves increases, the pressure and flow are well approximated by a continuum of valves which can be analytically treated. Interestingly, two different pumping mechanisms emerge from this model. At low frequencies, diffusive transport pushes open all but one valve, and the radius takes the shape of the imposed force. At high frequencies, half of the valves open, and the flow is determined by the advective transport induced by peristalsis. In either case, the induced flow is linear in the amplitude of the peristaltic forces and is independent of pumping direction. Despite the continuum approximation used, the physical valve density is accounted for by modifying the resistance of the fluid appropriately. The suppression of backflow causes a net benefit in adding valves when the valve density is low, but once the density is high enough, the dominant valve effect is to suppress the forward flow, suggesting there is an optimum number of valves per wavelength.


Risk Model of German Corona Warning App Reloaded. In this paper we discuss the risk model of the German Corona Warning App (CWA) in two versions. Both are based on a general semi quantitative risk approach that is not state of the art anymore and for some application domains even deprecated. However, it turns out that the CWA uses a much more limited model, that does not even assess risk, but relies only on one parameter, a weighted exposure time. It is shown that the CWA grossly underestimates even this parameter and so may reassure the users wrongly. As the CWA also has other systematic limitations and shortcomings it is advised not to rely on its results but rather on Covid testing and vaccination.


Contrastive Learning with Large Memory Bank and Negative Embedding Subtraction for Accurate Copy Detection. Copy detection, which is a task to determine whether an image is a modified copy of any image in a database, is an unsolved problem. Thus, we addressed copy detection by training convolutional neural networks (CNNs) with contrastive learning. Training with a large memory bank and hard data augmentation enables the CNNs to obtain more discriminative representation. Our proposed negative embedding subtraction further boosts the copy detection accuracy. Using our methods, we achieved 1st place in the Facebook AI Image Similarity Challenge Descriptor Track. Our code is publicly available here url https github.com lyakaap ISC21 Descriptor Track 1st


Combining Local and Global Viewpoint Planning for Fruit Coverage. Obtaining 3D sensor data of complete plants or plant parts (e.g., the crop or fruit) is difficult due to their complex structure and a high degree of occlusion. However, especially for the estimation of the position and size of fruits, it is necessary to avoid occlusions as much as possible and acquire sensor information of the relevant parts. Global viewpoint planners exist that suggest a series of viewpoints to cover the regions of interest up to a certain degree, but they usually prioritize global coverage and do not emphasize the avoidance of local occlusions. On the other hand, there are approaches that aim at avoiding local occlusions, but they cannot be used in larger environments since they only reach a local maximum of coverage. In this paper, we therefore propose to combine a local, gradient based method with global viewpoint planning to enable local occlusion avoidance while still being able to cover large areas. Our simulated experiments with a robotic arm equipped with a camera array as well as an RGB D camera show that this combination leads to a significantly increased coverage of the regions of interest compared to just applying global coverage planning.


A Self Supervised Auxiliary Loss for Deep RL in Partially Observable Settings. In this work we explore an auxiliary loss useful for reinforcement learning in environments where strong performing agents are required to be able to navigate a spatial environment. The auxiliary loss proposed is to minimize the classification error of a neural network classifier that predicts whether or not a pair of states sampled from the agents current episode trajectory are in order. The classifier takes as input a pair of states as well as the agent's memory. The motivation for this auxiliary loss is that there is a strong correlation with which of a pair of states is more recent in the agents episode trajectory and which of the two states is spatially closer to the agent. Our hypothesis is that learning features to answer this question encourages the agent to learn and internalize in memory representations of states that facilitate spatial reasoning. We tested this auxiliary loss on a navigation task in a gridworld and achieved 9.6 increase in accumulative episode reward compared to a strong baseline approach.


On Tsallis extropy with an application to pattern recognition. Recently, a new measure of information called extropy has been introduced by Lad, Sanfilippo and Agr o as the dual version of Shannon entropy. In the literature, Tsallis introduced a measure for a discrete random variable, named Tsallis entropy, as a generalization of Boltzmann Gibbs statistics. In this work, a new measure of discrimination, called Tsallis extropy, is introduced and some of its properties are then discussed. The relation between Tsallis extropy and entropy is given and some bounds are also presented. Finally, an application of this extropy to pattern recognition is demonstrated.


Guided by the primes an exploration of very triangular numbers. We present a string of results concerning very triangular numbers, paralleling fundamental theorems established for prime numbers throughout the history of their study, from Euclid ( sim 300 BCE) to Green Tao (2008) and beyond.


Learning Triadic Belief Dynamics in Nonverbal Communication from Videos. Humans possess a unique social cognition capability nonverbal communication can convey rich social information among agents. In contrast, such crucial social characteristics are mostly missing in the existing scene understanding literature. In this paper, we incorporate different nonverbal communication cues (e.g., gaze, human poses, and gestures) to represent, model, learn, and infer agents' mental states from pure visual inputs. Crucially, such a mental representation takes the agent's belief into account so that it represents what the true world state is and infers the beliefs in each agent's mental state, which may differ from the true world states. By aggregating different beliefs and true world states, our model essentially forms "five minds" during the interactions between two agents. This "five minds" model differs from prior works that infer beliefs in an infinite recursion instead, agents' beliefs are converged into a "common mind". Based on this representation, we further devise a hierarchical energy based model that jointly tracks and predicts all five minds. From this new perspective, a social event is interpreted by a series of nonverbal communication and belief dynamics, which transcends the classic keyframe video summary. In the experiments, we demonstrate that using such a social account provides a better video summary on videos with rich social interactions compared with state of the art keyframe video summary methods.


Geometric Transformers for Protein Interface Contact Prediction. Computational methods for predicting the interface contacts between proteins come highly sought after for drug discovery as they can significantly advance the accuracy of alternative approaches, such as protein protein docking, protein function analysis tools, and other computational methods for protein bioinformatics. In this work, we present the Geometric Transformer, a novel geometry evolving graph transformer for rotation and translation invariant protein interface contact prediction, packaged within DeepInteract, an end to end prediction pipeline. DeepInteract predicts partner specific protein interface contacts (i.e., inter protein residue residue contacts) given the 3D tertiary structures of two proteins as input. In rigorous benchmarks, DeepInteract, on challenging protein complex targets from the 13th and 14th CASP CAPRI experiments as well as Docking Benchmark 5, achieves 14 and 1.1 top L 5 precision (L length of a protein unit in a complex), respectively. In doing so, DeepInteract, with the Geometric Transformer as its graph based backbone, outperforms existing methods for interface contact prediction in addition to other graph based neural network backbones compatible with DeepInteract, thereby validating the effectiveness of the Geometric Transformer for learning rich relational geometric features for downstream tasks on 3D protein structures.


Inmate population models with nonhomogeneous sentence lengths and their effects in an epidemiological model. In this work, we develop an inmate population model with a sentencing length structure. The sentence length structure of new inmates represents the problem data and can usually be estimated from the histograms corresponding to the conviction times that are sentenced in a given population. We obtain a transport equation, typically known as the McKendrick equation, the homogenous version of which is included in population models with age structures. Using this equation, we compute the inmate population and entry exit rates in equilibrium, which are the values to consider in the design of a penitentiary system. With data from the Chilean penitentiary system, we illustrate how to perform these computations. In classifying the inmate population into two groups of sentence lengths (short and long), we incorporate the SIS (susceptible infected susceptible) epidemiological model, which considers the entry of infective individuals. We show that a failure to consider the structure of the sentence lengths as is common in epidemiological models developed for inmate populations for prevalences of new inmates below a certain threshold induces an underestimation of the prevalence in the prison population at steady state. The threshold depends on the basic reproduction number associated with the nonstructured SIS model with no entry of new inmates. We illustrate our findings with analytical and numerical examples for different distributions of sentencing lengths.


Imaging the transverse spin density of light via electromagnetically induced transparency. When a light beam is strongly laterally confined, its field vector spins in a plane not perpendicular to the propagation direction, leading to the presence of transverse spin angular momentum, which plays a crucial role in the field of chiral quantum optics. The existing techniques to measure the transverse spin density require complex setups and sophisticated time consuming procedures. Here, we propose a scheme to measure the transverse spin density of an optical field in real time using a multi level atomic medium. The susceptibility of the medium is spatially modulated by the transverse spin via electromagnetically induced transparency. The distribution of the transverse spin is then extracted by measuring the distributions of the Stokes parameters of another collimated probe field.


On the Prevention of Privacy Threats How Can We Persuade Our Social Network Users?. Complex decision making problems such as the privacy policy selection when sharing content in online social networks can significantly benefit from artificial intelligence systems. With the use of Computational Argumentation, it is possible to persuade human users to modify their initial decisions to avoid potential privacy threats and violations. In this paper, we present a study performed over 186 teenage users aimed at analysing their behaviour when we try to persuade them to modify their initial decisions in online social networks with different arguments. The results of the study revealed that the personality traits and the social interaction data (e.g., number of comments, friends, and likes) of our participants were significantly correlated with the persuasive power of the arguments. The findings from this analysis will help to model OSN users and define persuasive strategies for argumentation dialogues in this domain.


Ciliary flocking and emergent instabilities enable collective agility in a non neuromuscular animal. Effective organismal behavior responds appropriately to changes in the surrounding environment. Attaining this delicate balance of sensitivity and stability is a hallmark of the animal kingdom. By studying the locomotory behavior of a simple animal ( textit Trichoplax adhaerens ) without muscles or neurons, here, we demonstrate how monociliated epithelial cells work collectively to give rise to an agile non neuromuscular organism. Via direct visualization of large ciliary arrays, we report the discovery of sub second ciliary reorientations under a rotational torque that is mediated by collective tissue mechanics and the adhesion of cilia to the underlying substrate. In a toy model, we show a mapping of this system onto an "active elastic resonator". This framework explains how perturbations propagate information in this array as linear speed traveling waves in response to mechanical stimulus. Next, we explore the implications of parametric driving in this active elastic resonator and show that such driving can excite mechanical 'spikes'. These spikes in collective mode amplitudes are consistent with a system driven by parametric amplification and a saturating nonlinearity. We conduct extensive numerical experiments to corroborate these findings within a polarized active elastic sheet. These results indicate that periodic and stochastic forcing are valuable for increasing the sensitivity of collective ciliary flocking. We support these theoretical predictions via direct experimental observation of linear speed traveling waves which arise from the hybridization of spin and overdamped density waves. We map how these ciliary flocking dynamics result in agile motility via coupling between an amplified resonator and a tuning (Goldstone like) mode of the system. This sets the stage for how activity and elasticity can self organize into behavior which benefits the organism as a whole.


Development and Validation of MicrobEx an Open Source Package for Microbiology Culture Concept Extraction. Microbiology culture reports contain critical information for important clinical and public health applications. However, microbiology reports often have complex, semi structured, free text data that present a barrier for secondary use. Here we present the development and validation of an open source package designed to ingest free text microbiology reports, determine whether the culture is positive, and return a list of SNOMED CT mapped bacteria. Our rule based natural language processing algorithm was developed using microbiology reports from two different electronic health record systems in a large healthcare organization, and then externally validated on the reports of two other institutions with manually extracted results as a benchmark. Our algorithm achieved F 1 scores 0.95 on all classification tasks across both validation sets. Our concept extraction Python package, MicrobEx, is designed to be reused and adapted to individual institutions as an upstream process for other clinical applications, such as machine learning studies, clinical decision support, and disease surveillance systems.


Roundness Properties of Banach spaces. The maximal roundness of a metric space is a quantity that arose in the study of embeddings and renormings. In the setting of Banach spaces, it was shown by Enflo that roundness takes on a much simpler form. In this paper we provide simple computations of the roundness of many standard Banach spaces, such as ell p , the Lebesgue Bochner spaces ell p ( ell q ) and the Schatten ideals S p . We also introduce a property that is dual to that of roundness, which we call coroundness, and make explicit the relation of these properties to the geometric concepts of smoothness and convexity of Banach spaces. Building off the work of Enflo, we are then able to provide multiple non trivial equivalent conditions for a Banach space to possess maximal roundness greater than 1 . Using these conditions, we are able to conclude that certain Orlicz spaces possess non trivial values of roundness and coroundness. Finally, we also use these conditions to provide an explicit example of a 2 dimensional Banach space whose maximal roundness is not equal to that of its dual.


Physics Coupled Spatio Temporal Active Learning for Dynamical Systems. Spatio temporal forecasting is of great importance in a wide range of dynamical systems applications from atmospheric science, to recent COVID 19 spread modeling. These applications rely on accurate predictions of spatio temporal structured data reflecting real world phenomena. A stunning characteristic is that the dynamical system is not only driven by some physics laws but also impacted by the localized factor in spatial and temporal regions. One of the major challenges is to infer the underlying causes, which generate the perceived data stream and propagate the involved causal dynamics through the distributed observing units. Another challenge is that the success of machine learning based predictive models requires massive annotated data for model training. However, the acquisition of high quality annotated data is objectively manual and tedious as it needs a considerable amount of human intervention, making it infeasible in fields that require high levels of expertise. To tackle these challenges, we advocate a spatio temporal physics coupled neural networks (ST PCNN) model to learn the underlying physics of the dynamical system and further couple the learned physics to assist the learning of the recurring dynamics. To deal with data acquisition constraints, an active learning mechanism with Kriging for actively acquiring the most informative data is proposed for ST PCNN training in a partially observable environment. Our experiments on both synthetic and real world datasets exhibit that the proposed ST PCNN with active learning converges to near optimal accuracy with substantially fewer instances.


Coincident angle resolved state selective photoelectron spectroscopy of acetylene molecules a candidate system for time resolved dynamics. The acetylene vinylidene system serves as a benchmark for investigations of ultrafast dynamical processes where the coupling of the electronic and nuclear degrees of freedom provides a fertile playground to explore the femto and sub femto second physics with coherent extreme ultraviolet (EUV) photon sources both on the table top as well as free electron lasers. We focus on detailed investigations of this molecular system in the photon energy range 19...40 eV where EUV pulses can probe the dynamics effectively. We employ photoelectron photoion coincidence (PEPICO) spectroscopy to uncover hitherto unrevealed aspects of this system. In this work, the role of excited states of the C 2 H 2 cation, the primary photoion, is specifically addressed. From photoelectron energy spectra and angular distributions, the nature of the dissociation and isomerization channels is discerned. Exploiting the 4 pi collection geometry of velocity map imaging spectrometer, we not only probe pathways where the efficiency of photoionization is inherently high but also perform PEPICO spectroscopy on relatively weak channels.


Boosted Genetic Algorithm using Machine Learning for traffic control optimization. Traffic control optimization is a challenging task for various traffic centers around the world and the majority of existing approaches focus only on developing adaptive methods under normal (recurrent) traffic conditions. Optimizing the control plans when severe incidents occur still remains an open problem, especially when a high number of lanes or entire intersections are affected. This paper aims at tackling this problem and presents a novel methodology for optimizing the traffic signal timings in signalized urban intersections, under non recurrent traffic incidents. With the purpose of producing fast and reliable decisions, we combine the fast running Machine Learning (ML) algorithms and the reliable Genetic Algorithms (GA) into a single optimization framework. As a benchmark, we first start with deploying a typical GA algorithm by considering the phase duration as the decision variable and the objective function to minimize the total travel time in the network. We fine tune the GA for crossover, mutation, fitness calculation and obtain the optimal parameters. Secondly, we train various machine learning regression models to predict the total travel time of the studied traffic network, and select the best performing regressor which we further hyper tune to find the optimal training parameters. Lastly, we propose a new algorithm BGA ML combining the GA algorithm and the extreme gradient decision tree, which is the best performing regressor, together in a single optimization framework. Comparison and results show that the new BGA ML is much faster than the original GA algorithm and can be successfully applied under non recurrent incident conditions.


An Explanatory Query Based Framework for Exploring Academic Expertise. The success of research institutions heavily relies upon identifying the right researchers "for the job" researchers may need to identify appropriate collaborators, often from across disciplines students may need to identify suitable supervisors for projects of their interest administrators may need to match funding opportunities with relevant researchers, and so on. Usually, finding potential collaborators in institutions is a time consuming manual search task prone to bias. In this paper, we propose a novel query based framework for searching, scoring, and exploring research expertise automatically, based upon processing abstracts of academic publications. Given user queries in natural language, our framework finds researchers with relevant expertise, making use of domain specific knowledge bases and word embeddings. It also generates explanations for its recommendations. We evaluate our framework with an institutional repository of papers from a leading university, using, as baselines, artificial neural networks and transformer based models for a multilabel classification task to identify authors of publication abstracts. We also assess the cross domain effectiveness of our framework with a (separate) research funding repository for the same institution. We show that our simple method is effective in identifying matches, while satisfying desirable properties and being efficient.


On a conjecture on APN permutations. The single trivariate representation proposed in C. Beierle, C. Carlet, G. Leander, L. Perrin, A Further Study of Quadratic APN Permutations in Dimension Nine, arXiv 2104.08008 of the two sporadic quadratic APN permutations in dimension 9 found by Beierle and Leander cite Beierle is further investigated. In particular, using tools from algebraic geometry over finite fields, we prove that such a family does not contain any other APN permutation for larger dimensions.


An Impossibility Result on Strong Linearizability in Message Passing Systems. We prove that in asynchronous message passing systems where at most one process may crash, there is no lock free strongly linearizable implementation of a weak object that we call Test or Set (ToS). This object allows a single distinguished process to apply the set operation once, and a different distinguished process to apply the test operation also once. Since this weak object can be directly implemented by a single writer single reader (SWSR) register (and other common objects such as max register, snapshot and counter), this result implies that there is no 1 resilient lock free strongly linearizable implementation of a SWSR register (and of these other objects) in message passing systems. We also prove that there is no 1 resilient lock free emph write strongly linearizable implementation of a 2 writer 1 reader (2W1R) register in asynchronous message passing systems.


Approximation schemes for bounded distance problems on fractionally treewidth fragile graphs. We give polynomial time approximation schemes for monotone maximization problems expressible in terms of distances (up to a fixed upper bound) and efficiently solvable in graphs of bounded treewidth. These schemes apply in all fractionally treewidth fragile graph classes, a property that is true for many natural graph classes with sublinear separators. We also provide quasipolynomial time approximation schemes for these problems in all classes with sublinear separators.


The minimal genus problem for right angled Artin groups. We investigate the minimal genus problem for the second homology of a right angled Artin group (RAAG). Firstly, we present a lower bound for the minimal genus of a second homology class, equal to half the rank of the corresponding cap product matrix. We show that for complete graphs, trees, and complete bipartite graphs, this bound is an equality, and furthermore in these cases the minimal genus can always be realised by a disjoint union of tori. Additionally, we give a full characterisation of classes that are representable by a single torus. However, it is not true in general that the minimal genus of a second homology class of a RAAG is necessarily realised by a disjoint union of tori we construct a genus two representative for a class in the pentagon RAAG.


Parameterising continuum level Li ion battery models the LiionDB database. The Doyle Fuller Newman framework is the most popular physics based continuum level description of the chemical and dynamical internal processes within operating lithium ion battery cells. With sufficient flexibility to model a wide range of battery designs and chemistries, the framework provides an effective balance between detail, needed to capture key microscopic mechanisms, and simplicity, needed to solve the governing equations at a relatively modest computational expense. Nevertheless, implementation requires values of numerous model parameters, whose ranges of applicability, estimation, and validation pose challenges. This article provides a critical review of the methods to measure or infer parameters for use within the isothermal DFN framework, discusses their advantages or disadvantages, and clarifies limitations attached to their practical application. Accompanying this discussion we provide a searchable database, available at www.liiondb.com, which aggregates many parameters and state functions for the standard Doyle Fuller Newman model that have been reported in the literature.


On the geometry of non degenerate surfaces in Lorentzian homogeneous 3 manifolds. In this paper we deal with non degenerate surfaces Sigma 2 immersed in the 3 dimensional homogeneous space mathbb L 3 ( kappa, tau) endowed with two different metrics, the one induced by the Riemannian metric of mathbb E 3( kappa, tau) and the non degenerate metric inherited by the Lorentzian one of mathbb L 3( kappa, tau) . Therefore, we have two different geometries on Sigma 2 and we can compare them. In particular, we study the case where the mean curvature functions with respect to both metrics simultaneously vanish, and in this case we show that the surface is ruled. Furthermore, we consider the case where both mean curvature functions coincide but do not necessarily vanish and we also consider the situation where the extrinsic curvatures with respect to both metrics coincide.


An Asynchronous Approximate Distributed Alternating Direction Method of Multipliers in Digraphs. In this work, we consider the asynchronous distributed optimization problem in which each node has its own convex cost function and can communicate directly only with its neighbors, as determined by a directed communication topology (directed graph or digraph). First, we reformulate the optimization problem so that Alternating Direction Method of Multipliers (ADMM) can be utilized. Then, we propose an algorithm, herein called Asynchronous Approximate Distributed Alternating Direction Method of Multipliers (AsyAD ADMM), using finite time asynchronous approximate ratio consensus, to solve the multi node convex optimization problem, in which every node performs iterative computations and exchanges information with its neighbors asynchronously. More specifically, at every iteration of AsyAD ADMM, each node solves a local convex optimization problem for one of the primal variables and utilizes a finite time asynchronous approximate consensus protocol to obtain the value of the other variable which is close to the optimal value, since the cost function for the second primal variable is not decomposable. If the individual cost functions are convex but not necessarily differentiable, the proposed algorithm converges at a rate of mathcal O (1 k) , where k is the iteration counter. The efficacy of AsyAD ADMM is exemplified via a proof of concept distributed least square optimization problem with different performance influencing factors investigated.


Predicting 3D RNA Folding Patterns via Quadratic Binary Optimization. The structure of an RNA molecule plays a significant role in its biological function. Predicting structure given a one dimensional sequence of RNA nucleotide bases is a difficult and important problem. Many computer programs (known as in silico) are available for predicting 2 dimensional (secondary) structures however 3 dimensional (tertiary) structure prediction is much more difficult mainly due to the far greater number of feasible solutions and fewer experimental data on the thermodynamic energies of 3D structures. It is also challenging to verify the most likely three dimensional structure even with the availability of sophisticated x ray crystallography and nuclear magnetic resonance imaging technologies. In this paper we develop three dimensional RNA folding predictions by adding penalty and reward parameters to a previous two dimensional approach based on Quadratic Unconstrained Binary Optimization (QUBO) models. These parameters provide flexibility in the amount of three dimensional folding allowed. We address the problem of multiple near optimal structures via a new weighted similarity structure measure and illustrate folding pathways via progressively improving local optimal solutions. The problems are solved via a new commercial QUBO solver AlphaQUBO (Meta Analytics, 2020) that solves problems having hundreds of thousands of binary variables.


Coreference Resolution in Research Papers from Multiple Domains. Coreference resolution is essential for automatic text understanding to facilitate high level information retrieval tasks such as text summarisation or question answering. Previous work indicates that the performance of state of the art approaches (e.g. based on BERT) noticeably declines when applied to scientific papers. In this paper, we investigate the task of coreference resolution in research papers and subsequent knowledge graph population. We present the following contributions (1) We annotate a corpus for coreference resolution that comprises 10 different scientific disciplines from Science, Technology, and Medicine (STM) (2) We propose transfer learning for automatic coreference resolution in research papers (3) We analyse the impact of coreference resolution on knowledge graph (KG) population (4) We release a research KG that is automatically populated from 55,485 papers in 10 STM domains. Comprehensive experiments show the usefulness of the proposed approach. Our transfer learning approach considerably outperforms state of the art baselines on our corpus with an F1 score of 61.4 ( 11.0), while the evaluation against a gold standard KG shows that coreference resolution improves the quality of the populated KG significantly with an F1 score of 63.5 ( 21.8).


Optimality Conditions for Variational Problems in Incomplete Functional Spaces. This paper develops a novel approach to necessary optimality conditions for constrained variational problems defined in generally incomplete subspaces of absolutely continuous functions. Our approach involves reducing a variational problem to a (nondynamic) problem of constrained optimization in a normed space and then applying the results recently obtained for the latter class using generalized differentiation. In this way, we derive necessary optimality conditions for nonconvex problems of the calculus of variations with velocity constraints under the weakest metric subregularity type constraint qualification. The developed approach leads us to a short and simple proof of the First order necessary optimality conditions for such and related problems in broad spaces of functions, including those of class C k.


Semicomplete Arithmetic Sequences, Division of Hypercubes, and the Pell Constant. In this paper we produce a few continuations of our previous work on partitions into fractions. Specifically, we study strictly increasing integer sequences n j such that there are partitions for all integers less than the floor of G , where G frac n 1 j frac n 2 j cdots frac n j 1 j frac n j j , and all summands are distinct terms drawn from frac n 1 j frac n 2 j cdots frac n j 1 j frac n j j . We call such sequences enquote semicomplete . We find that there are only three semicomplete arithmetic sequences. We also study sequences that give the maximum number of pieces that an M dimensional hypercube can be cut into using N 1 hyperplanes. We find that these are semicomplete in one, two, three, and four dimensions. As an aside, we use one of our generating functions to produce what appears to be a new identity for the Pell constant, a number which is closely connected to the density of solutions to the negative Pell equation.


Characterization and recognition of handwritten digits using Julia. Automatic image and digit recognition is a computationally challenging task for image processing and pattern recognition, requiring an adequate appreciation of the syntactic and semantic importance of the image for the identification ofthe handwritten digits. Image and Pattern Recognition has been identified as one of the driving forces in the research areas because of its shifting of different types of applications, such as safety frameworks, clinical frameworks, diversion, and so on.In this study, for recognition, we implemented a hybrid neural network model that is capable of recognizing the digit of MNISTdataset and achieved a remarkable result. The proposed neural model network can extract features from the image and recognize the features in the layer by layer. To expand, it is so important for the neural network to recognize how the proposed modelcan work in each layer, how it can generate output, and so on. Besides, it also can recognize the auto encoding system and the variational auto encoding system of the MNIST dataset. This study will explore those issues that are discussed above, and the explanation for them, and how this phenomenon can be overcome.


Investigating Transfer Learning Capabilities of Vision Transformers and CNNs by Fine Tuning a Single Trainable Block. In recent developments in the field of Computer Vision, a rise is seen in the use of transformer based architectures. They are surpassing the state of the art set by CNN architectures in accuracy but on the other hand, they are computationally very expensive to train from scratch. As these models are quite recent in the Computer Vision field, there is a need to study it's transfer learning capabilities and compare it with CNNs so that we can understand which architecture is better when applied to real world problems with small data. In this work, we follow a simple yet restrictive method for fine tuning both CNN and Transformer models pretrained on ImageNet1K on CIFAR 10 and compare them with each other. We only unfreeze the last transformer encoder or last convolutional block of a model and freeze all the layers before it while adding a simple MLP at the end for classification. This simple modification lets us use the raw learned weights of both these neural networks. From our experiments, we find out that transformers based architectures not only achieve higher accuracy than CNNs but some transformers even achieve this feat with around 4 times lesser number of parameters.


Head mounted Displays, Smartphones, or Smartwatches? Augmenting Conversations with Digital Representation of Self. Technologies that augment face to face interactions with a digital sense of self have been used to support conversations. That work has employed one homogenous technology, either 'off the shelf' or with a bespoke prototype, across all participants. Beyond speculative instances, it is unclear what technology individuals themselves would choose, if any, to augment their social interactions what influence it may exert or how use of heterogeneous devices may affect the value of this augmentation. This is important, as the devices that we use directly affect our behaviour, influencing affordances and how we engage in social interactions. Through a study of 28 participants, we compared head mounted display, smartphones, and smartwatches to support digital augmentation of self during face to face interactions within a group. We identified a preference among participants for head mounted displays to support privacy, while smartwatches and smartphones better supported conversational events (such as grounding and repair), along with group use through screen sharing. Accordingly, we present software and hardware design recommendations and user interface guidelines for integrating a digital form of self into face to face conversations.


Black box Adversarial Attacks on Monocular Depth Estimation Using Evolutionary Multi objective Optimization. This paper proposes an adversarial attack method to deep neural networks (DNNs) for monocular depth estimation, i.e., estimating the depth from a single image. Single image depth estimation has improved drastically in recent years due to the development of DNNs. However, vulnerabilities of DNNs for image classification have been revealed by adversarial attacks, and DNNs for monocular depth estimation could contain similar vulnerabilities. Therefore, research on vulnerabilities of DNNs for monocular depth estimation has spread rapidly, but many of them assume white box conditions where inside information of DNNs is available, or are transferability based black box attacks that require a substitute DNN model and a training dataset. Utilizing Evolutionary Multi objective Optimization, the proposed method in this paper analyzes DNNs under the black box condition where only output depth maps are available. In addition, the proposed method does not require a substitute DNN that has a similar architecture to the target DNN nor any knowledge about training data used to train the target model. Experimental results showed that the proposed method succeeded in attacking two DNN based methods that were trained with indoor and outdoor scenes respectively.


BlueFog Make Decentralized Algorithms Practical for Optimization and Deep Learning. Decentralized algorithm is a form of computation that achieves a global goal through local dynamics that relies on low cost communication between directly connected agents. On large scale optimization tasks involving distributed datasets, decentralized algorithms have shown strong, sometimes superior, performance over distributed algorithms with a central node. Recently, developing decentralized algorithms for deep learning has attracted great attention. They are considered as low communication overhead alternatives to those using a parameter server or the Ring Allreduce protocol. However, the lack of an easy to use and efficient software package has kept most decentralized algorithms merely on paper. To fill the gap, we introduce BlueFog, a python library for straightforward, high performance implementations of diverse decentralized algorithms. Based on a unified abstraction of various communication operations, BlueFog offers intuitive interfaces to implement a spectrum of decentralized algorithms, from those using a static, undirected graph for synchronous operations to those using dynamic and directed graphs for asynchronous operations. BlueFog also adopts several system level acceleration techniques to further optimize the performance on the deep learning tasks. On mainstream DNN training tasks, BlueFog reaches a much higher throughput and achieves an overall 1.2 times sim 1.8 times speedup over Horovod, a state of the art distributed deep learning package based on Ring Allreduce. BlueFog is open source at https github.com Bluefog Lib bluefog.


Foundations of abstract probability theory. In this article, we introduce the basic concepts of abstract or general probability theory. Using the ideas of abstract algebra, we introduce the concept of an abstract measure. We define an abstract probability measure that takes the values of elements from certain sets and satisfies a system of axioms that generalizes the system of Kolmogorov's axioms. We show that the abstract probability measure has properties similar to those of a classical probabiity measure, and also obtain a formula for calculating the conditional abstract probability. We prove abstract analogues of Bayes' theorem and the law of total probability. We introduce the concept of an abstract probability distribution of a random variable. Moreover, we define an abstract Lebesgue integral and determine the abstract expected value operator. After that, we describe some special cases of abstract probability theory.


Effect of the finite speed of light in ionization of extended systems. We study propagation effects due to the finite speed of light in ionization of extended systems. We present a general quantitative theory of these effects and show under which conditions such effects should appear. The finite speed of light propagation effects are encoded in the non dipole terms of the time dependent Shr "odinger equation and display themselves in the photoelectron momentum distribution projected on the molecular axis. Our numerical modeling for the Hp molecular ion and the Ne dimer shows that the finite light propagation time from one atomic center to another can be accurately determined in a table top laser experiment which is much more readily affordable than an earlier synchrotron measurement by Grundmann em et al Science 370, 339 (2020)


On L p Liouville theorems for Dirichlet forms. We study harmonic functions for general Dirichlet forms. First we review consequences of Fukushima's ergodic theorem for the harmonic functions in the domain of the L p generator. Secondly we prove analogues of Yau's and Karp's Liouville theorems for weakly harmonic functions. Both say that weakly harmonic functions which satisfy certain L p growth criteria must be constant. As consequence we give an integral criterion for recurrence.


An extensible equality checking algorithm for dependent type theories. We present a general and user extensible equality checking algorithm that is applicable to a large class of type theories. The algorithm has a type directed phase for applying extensionality rules and a normalization phase based on computation rules, where both kinds of rules are defined using the type theoretic concept of object invertible rules. We also give sufficient syntactic criteria for recognizing such rules, as well as a simple pattern matching algorithm for applying them. A third component of the algorithm is a suitable notion of principal arguments, which determines a notion of normal form. By varying these, we obtain known notions, such as weak head normal and strong normal forms. We prove that our algorithm is sound. We implemented it in the Andromeda 2 proof assistant, which supports user definable type theories. The user need only provide the equality rules they wish to use, which the algorithm automatically classifies as computation or extensionality rules, and select appropriate principal arguments.


Multidimensional diffusion MRI methods with confined subdomains. Diffusion Magnetic Resonance Imaging (dMRI) is an imaging technique with exquisite sensitivity to the microstructural properties of heterogeneous media. The conventionally adopted acquisition schemes involving single pulsed field gradients encode the random motion of water molecules into the NMR signal, however typically conflating the effects of different sources contributing to the water motion. Time varying magnetic field gradients have recently been considered for disentangling such effects during the data encoding phase, opening to the possibility of adding specificity to the recovered information about the medium's microstructure. Such data is typically represented via a diffusion tensor distribution (DTD) model, thus assuming the existence of several non exchanging compartments in each of which diffusion is unrestricted. In this work, we consider a model that takes confinement into account and possesses a diffusion time dependence closer to that of restricted diffusion, to replace the free diffusion assumption in multidimensional diffusion MRI methods. We first demonstrate how the confinement tensor model captures the relevant signal modulations impressed by water diffusing in both free and closed spaces, for data simulated with a clinically feasible protocol involving time varying magnetic field gradients. Then, we provide the basis for incorporating this model into two multidimensional dMRI methods, and attempt to recover a confinement tensor distribution (CTD) on a human brain dataset.


Theoretical band gap bounds and coupling sensitivity for a periodic medium with branching resonators. Elastic metamaterials may exhibit band gaps at wavelengths far exceeding feature sizes. This is attributed to local resonances of embedded or branching substructures. In branched configurations, such as a pillared plate, waves propagating in the base medium e.g., the plate portion experience attenuation at band gap frequencies. Considering a simplified lumped parameter model for a branched medium, we present a theoretical treatment for a periodic unit cell comprising a base mass spring chain with a multi degree of freedom, mono coupled branch. Bloch's theorem is applied, combined with a sub structuring approach where the resonating branch is modelled separately and condensed into its effective dynamic stiffness. Thus, the treatment is generally applicable to an arbitrary branch regardless of its size and properties. We provide an analysis with guiding graphical illustrations that yields an identification of fundamental bounds for the band gap edges as dictated by the dynamical characteristics of the branch. Analytical sensitivity functions are also derived for the dependence of these bounds on the degree of coupling between the base and the branch. The sensitivity analysis reveals further novel findings including the role of the frequency derivative of the branch dynamic stiffness in providing a direct relation between the band gap edge locations and variation in the coupling parameters the mass and stiffness ratios between the base chain and the branch root. In additional analysis, sub Bragg bounds of an exact model comprising a one dimensional (1D) continuous base modelled as a rod and a discrete branch are derived and shown to be tighter than those of the all discrete model. Finally, the applicability of the derived bounds and sensitivity functions are shown to be valid for a corresponding full 2D finite element model of a pillared waveguide admitting out of plane shear waves.


The Green Tao theorem for affine curves over F q. Green and Tao famously proved in a 2008 paper that there are arithmetic progressions of prime numbers of arbitrary lengths. Soon after, analogous statements were proved by Tao for the ring of Gaussian integers and by L e for the polynomial rings over finite fields. In 2020 this was extented to orders of arbitrary number fields by Kai Mimura Munemasa Seki Yoshino. We settle the case of the coordinate rings of affine curves over finite fields. The main contribution of this paper is subtle choice of a polynomial subring of the given ring which plays the role of mathbb Z in the number field case. This choice and the proof of its pleasant properties eventually depend on the Riemann Roch formula.


StarNet Joint Action Space Prediction with Star Graphs and Implicit Global Frame Self Attention. In this work, we present a novel multi modal multi agent trajectory prediction architecture, focusing on map and interaction modeling using graph representation. For the purposes of map modeling, we capture rich topological structure into vector based star graphs, which enable an agent to directly attend to relevant regions along polylines that are used to represent the map. We denote this architecture StarNet, and integrate it in a single agent prediction setting. As the main result, we extend this architecture to joint scene level prediction, which produces multiple agents' predictions simultaneously. The key idea in joint StarNet is integrating the awareness of one agent in its own reference frame with how it is perceived from the points of view of other agents. We achieve this via masked self attention. Both proposed architectures are built on top of the action space prediction framework introduced in our previous work, which ensures kinematically feasible trajectory predictions. We evaluate the methods on the interaction rich inD and INTERACTION datasets, with both StarNet and joint StarNet achieving improvements over state of the art.


Exploring Social Posterior Collapse in Variational Autoencoder for Interaction Modeling. Multi agent behavior modeling and trajectory forecasting are crucial for the safe navigation of autonomous agents in interactive scenarios. Variational Autoencoder (VAE) has been widely applied in multi agent interaction modeling to generate diverse behavior and learn a low dimensional representation for interacting systems. However, existing literature did not formally discuss if a VAE based model can properly encode interaction into its latent space. In this work, we argue that one of the typical formulations of VAEs in multi agent modeling suffers from an issue we refer to as social posterior collapse, i.e., the model is prone to ignoring historical social context when predicting the future trajectory of an agent. It could cause significant prediction errors and poor generalization performance. We analyze the reason behind this under explored phenomenon and propose several measures to tackle it. Afterward, we implement the proposed framework and experiment on real world datasets for multi agent trajectory prediction. In particular, we propose a novel sparse graph attention message passing (sparse GAMP) layer, which helps us detect social posterior collapse in our experiments. In the experiments, we verify that social posterior collapse indeed occurs. Also, the proposed measures are effective in alleviating the issue. As a result, the model attains better generalization performance when historical social context is informative for prediction.


Implicit explicit BDF k SAV schemes for general dissipative systems and their error analysis. We construct efficient implicit explicit BDF k scalar auxiliary variable (SAV) schemes for general dissipative systems. We show that these schemes are unconditionally stable, and lead to a uniform bound of the numerical solution in the norm based on the principal linear operator in the energy. Based on this uniform bound, we carry out a rigorous error analysis for the k th order (k 1,2,3,4,5) SAV schemes in a unified form for a class of typical Allen Cahn type and Cahn Hilliard type equations. We also present numerical results confirming our theoretical convergence rates.


A Simple and Efficient Probabilistic Language model for Code Mixed Text. The conventional natural language processing approaches are not accustomed to the social media text due to colloquial discourse and non homogeneous characteristics. Significantly, the language identification in a multilingual document is ascertained to be a preceding subtask in several information extraction applications such as information retrieval, named entity recognition, relation extraction, etc. The problem is often more challenging in code mixed documents wherein foreign languages words are drawn into base language while framing the text. The word embeddings are powerful language modeling tools for representation of text documents useful in obtaining similarity between words or documents. We present a simple probabilistic approach for building efficient word embedding for code mixed text and exemplifying it over language identification of Hindi English short test messages scrapped from Twitter. We examine its efficacy for the classification task using bidirectional LSTMs and SVMs and observe its improved scores over various existing code mixed embeddings


The "Grothendieck to Lascoux" conjecture. This report formulates a conjectural combinatorial rule that positively expands Grothendieck polynomials into Lascoux polynomials. It generalizes one such formula expanding Schubert polynomials into key polynomials, and refines another one expanding stable Grothendieck polynomials.