Distributed Augmented Lagrangian Method for Link Based Resource Sharing Problems of Multi Agent Systems. A multi agent optimization problem motivated by the management of energy systems is discussed. The associated cost function is separable and convex although not necessarily strongly convex and there exist edge based coupling equality constraints. In this regard, we propose a distributed algorithm based on solving the dual of the augmented problem. Furthermore, we consider that the communication network might be time varying and the algorithm might be carried out asynchronously. The time varying nature and the asynchronicity are modeled as random processes. Then, we show the convergence and the convergence rate of the proposed algorithm under the aforementioned conditions.


Modeling differential rates of aging using routine laboratory data Implications for morbidity and health care expenditure. Aging is a multidimensional process where phenotypes change at varying rates. Longitudinal studies of aging typically involve following a cohort of individuals over the course of several years. This design is hindered by cost, attrition, and subsequently small sample size. Alternative methodologies are therefore warranted. In this study, we used a variational autoencoder to estimate rates of aging from cross sectional data from routine laboratory tests of 1.4 million individuals collected from 2016 to 2019. By incorporating metrics that would ensure model's stability and distinctness of the dimensions, we uncovered four aging dimensions that represent the following bodily functions 1) kidney, 2) thyroid, 3) white blood cells, and 4) liver and heart. We then examined the relationship between rates of aging on morbidity and health care expenditure. In general, faster agers along these dimensions are more likely to develop chronic diseases that are related to these bodily functions. They also had higher health care expenditures compared to the slower agers. K means clustering of individuals based on rate of aging revealed that clusters with higher odds of developing morbidity had the highest cost across all types of health care services. Results suggest that cross sectional laboratory data can be leveraged as an alternative methodology to understand age along the different dimensions. Moreover, rates of aging are differentially related to future costs, which can aid in the development of interventions to delay disease progression.


Ensemble of MRR and NDCG models for Visual Dialog. Assessing an AI agent that can converse in human language and understand visual content is challenging. Generation metrics, such as BLEU scores favor correct syntax over semantics. Hence a discriminative approach is often used, where an agent ranks a set of candidate options. The mean reciprocal rank (MRR) metric evaluates the model performance by taking into account the rank of a single human derived answer. This approach, however, raises a new challenge the ambiguity and synonymy of answers, for instance, semantic equivalence (e.g., yeah' and yes'). To address this, the normalized discounted cumulative gain (NDCG) metric has been used to capture the relevance of all the correct answers via dense annotations. However, the NDCG metric favors the usually applicable uncertain answers such as I don't know. Crafting a model that excels on both MRR and NDCG metrics is challenging. Ideally, an AI agent should answer a human like reply and validate the correctness of any answer. To address this issue, we describe a two step non parametric ranking approach that can merge strong MRR and NDCG models. Using our approach, we manage to keep most MRR state of the art performance (70.41 vs. 71.24 ) and the NDCG state of the art performance (72.16 vs. 75.35 ). Moreover, our approach won the recent Visual Dialog 2020 challenge. Source code is available at https github.com idansc mrr ndcg.


FedFog Network Aware Optimization of Federated Learning over Wireless Fog Cloud Systems. Federated learning (FL) is capable of performing large distributed machine learning tasks across multiple edge users by periodically aggregating trained local parameters. To address key challenges of enabling FL over a wireless fog cloud system (e.g., non i.i.d. data, users' heterogeneity), we first propose an efficient FL algorithm based on Federated Averaging (called FedFog) to perform the local aggregation of gradient parameters at fog servers and global training update at the cloud. Next, we employ FedFog in wireless fog cloud systems by investigating a novel network aware FL optimization problem that strikes the balance between the global loss and completion time. An iterative algorithm is then developed to obtain a precise measurement of the system performance, which helps design an efficient stopping criteria to output an appropriate number of global rounds. To mitigate the straggler effect, we propose a flexible user aggregation strategy that trains fast users first to obtain a certain level of accuracy before allowing slow users to join the global training updates. Extensive numerical results using several real world FL tasks are provided to verify the theoretical convergence of FedFog. We also show that the proposed co design of FL and communication is essential to substantially improve resource utilization while achieving comparable accuracy of the learning model.


Not All Relevance Scores are Equal Efficient Uncertainty and Calibration Modeling for Deep Retrieval Models. In any ranking system, the retrieval model outputs a single score for a document based on its belief on how relevant it is to a given search query. While retrieval models have continued to improve with the introduction of increasingly complex architectures, few works have investigated a retrieval model's belief in the score beyond the scope of a single value. We argue that capturing the model's uncertainty with respect to its own scoring of a document is a critical aspect of retrieval that allows for greater use of current models across new document distributions, collections, or even improving effectiveness for down stream tasks. In this paper, we address this problem via an efficient Bayesian framework for retrieval models which captures the model's belief in the relevance score through a stochastic process while adding only negligible computational overhead. We evaluate this belief via a ranking based calibration metric showing that our approximate Bayesian framework significantly improves a retrieval model's ranking effectiveness through a risk aware reranking as well as its confidence calibration. Lastly, we demonstrate that this additional uncertainty information is actionable and reliable on down stream tasks represented via cutoff prediction.


Social Engineering in Cybersecurity A Domain Ontology and Knowledge Graph Application Examples. Social engineering has posed a serious threat to cyberspace security. To protect against social engineering attacks, a fundamental work is to know what constitutes social engineering. This paper first develops a domain ontology of social engineering in cybersecurity and conducts ontology evaluation by its knowledge graph application. The domain ontology defines 11 concepts of core entities that significantly constitute or affect social engineering domain, together with 22 kinds of relations describing how these entities related to each other. It provides a formal and explicit knowledge schema to understand, analyze, reuse and share domain knowledge of social engineering. Furthermore, this paper builds a knowledge graph based on 15 social engineering attack incidents and scenarios. 7 knowledge graph application examples (in 6 analysis patterns) demonstrate that the ontology together with knowledge graph is useful to 1) understand and analyze social engineering attack scenario and incident, 2) find the top ranked social engineering threat elements (e.g. the most exploited human vulnerabilities and most used attack mediums), 3) find potential social engineering threats to victims, 4) find potential targets for social engineering attackers, 5) find potential attack paths from specific attacker to specific target, and 6) analyze the same origin attacks.


Learning compliant grasping and manipulation by teleoperation with adaptive force control. In this work, we focus on improving the robot's dexterous capability by exploiting visual sensing and adaptive force control. TeachNet, a vision based teleoperation learning framework, is exploited to map human hand postures to a multi fingered robot hand. We augment TeachNet, which is originally based on an imprecise kinematic mapping and position only servoing, with a biomimetic learning based compliance control algorithm for dexterous manipulation tasks. This compliance controller takes the mapped robotic joint angles from TeachNet as the desired goal, computes the desired joint torques. It is derived from a computational model of the biomimetic control strategy in human motor learning, which allows adapting the control variables (impedance and feedforward force) online during the execution of the reference joint angle trajectories. The simultaneous adaptation of the impedance and feedforward profiles enables the robot to interact with the environment in a compliant manner. Our approach has been verified in multiple tasks in physics simulation, i.e., grasping, opening a door, turning a cap, and touching a mouse, and has shown more reliable performances than the existing position control and the fixed gain based force control approaches.


Solving Cut Problems in Quadratic Time for Graphs With Bounded Treewidth. In the problem (Unweighted) Max Cut we are given a graph G (V,E) and asked for a set S subseteq V such that the number of edges from S to V setminus S is maximal. In this paper we consider an even harder problem (Weighted) Max Bisection. Here we are given an undirected graph G (V,E) and a weight function w colon E to mathbb Q 0 and the task is to find a set S subseteq V such that (i) the sum of the weights of edges from S is maximal and (ii) S contains roughly frac n 2 vertices (where n V ), that is smash big S V setminus S big leq 1 . We design a framework that allows to solve this problem in time mathcal O(2 t n 2) if a tree decomposition of treewidth t is given as part of the input. Under common hardness assumptions, neither the dependence on t nor the dependence on n can be reduced DBLP journals tcs HanakaKS21, DBLP journals jcss EibenLM21, DBLP journals talg LokshtanovMS18 . Our framework can be applied to other cut problems like Min Edge Expansion, Sparsest Cut, Densest Cut, beta Balanced Min Cut, and Min Bisection. It also works in the setting with arbitrary weights and directed edges.


A Distributed SGD Algorithm with Global Sketching for Deep Learning Training Acceleration. Distributed training is an effective way to accelerate the training process of large scale deep learning models. However, the parameter exchange and synchronization of distributed stochastic gradient descent introduce a large amount of communication overhead. Gradient compression is an effective method to reduce communication overhead. In synchronization SGD compression methods, many Top k sparsification based gradient compression methods have been proposed to reduce the communication. However, the centralized method based on the parameter servers has the single point of failure problem and limited scalability, while the decentralized method with global parameter exchanging may reduce the convergence rate of training. In contrast with Top k based methods, we proposed a gradient compression method with globe gradient vector sketching, which uses the Count Sketch structure to store the gradients to reduce the loss of the accuracy in the training process, named global sketching SGD (gs SGD). The gs SGD has better convergence efficiency on deep learning models and a communication complexity of O( log d log P ), where d is the number of model parameters and P is the number of workers. We conducted experiments on GPU clusters to verify that our method has better convergence efficiency than global Top k and Sketching based methods. In addition, gs SGD achieves 1.3 3.1x higher throughput compared with gTop k , and 1.1 1.2x higher throughput compared with original Sketched SGD.


Calderon Zygmund theory for non convolution type nonlocal equations with continuous coefficient. Given 2 leq p infty , s in (0, 1) and t in (1, 2s) , we establish interior W t,p Calderon Zygmund estimates for solutions of nonlocal equations of the form int Omega int Omega K left (x, x y , frac x y x y right ) frac (u(x) u(y))( varphi(x) varphi(y)) x y n 2s dx dy g varphi , quad forall phi in C c infty ( Omega) where Omega subset mathbb R n is an open set. Here we assume K is bounded, nonnegative and continuous in the first entry and ellipticity is ensured by assuming that K is strictly positive in a cone. The setup is chosen so that it is applicable for nonlocal equations on manifolds, but the structure of the equation is general enough that it also applies to the certain fractional p Laplace equations around points where u in C 1 and nabla u neq 0 .


On Homogeneous Landsberg Surfaces. In this paper, we prove that every homogeneous Landsberg surface has isotropic flag curvature. Using this special form of the flag curvature, we prove a rigidity result on homogeneous Landsberg surface. Indeed, we prove that every homogeneous Landsberg surface is Riemannian or locally Minkowskian. This gives a positive answer to the Xu Deng's well known conjecture in 2 dimensional homogeneous Finsler manifolds.


A Game Theoretic Approach for Improving Generalization Ability of TSP Solvers. In this paper, we introduce a two player zero sum framework between a trainable emph Solver and a emph Data Generator to improve the generalization ability of deep learning based solvers for Traveling Salesman Problem (TSP). Grounded in textsl Policy Space Response Oracle (PSRO) methods, our two player framework outputs a population of best responding Solvers, over which we can mix and output a combined model that achieves the least exploitability against the Generator, and thereby the most generalizable performance on different TSP tasks. We conduct experiments on a variety of TSP instances with different types and sizes. Results suggest that our Solvers achieve the state of the art performance even on tasks the Solver never meets, whilst the performance of other deep learning based Solvers drops sharply due to over fitting. To demonstrate the principle of our framework, we study the learning outcome of the proposed two player game and demonstrate that the exploitability of the Solver population decreases during training, and it eventually approximates the Nash equilibrium along with the Generator.


DL Traff Survey and Benchmark of Deep Learning Models for Urban Traffic Prediction. Nowadays, with the rapid development of IoT (Internet of Things) and CPS (Cyber Physical Systems) technologies, big spatiotemporal data are being generated from mobile phones, car navigation systems, and traffic sensors. By leveraging state of the art deep learning technologies on such data, urban traffic prediction has drawn a lot of attention in AI and Intelligent Transportation System community. The problem can be uniformly modeled with a 3D tensor (T, N, C), where T denotes the total time steps, N denotes the size of the spatial domain (i.e., mesh grids or graph nodes), and C denotes the channels of information. According to the specific modeling strategy, the state of the art deep learning models can be divided into three categories grid based, graph based, and multivariate time series models. In this study, we first synthetically review the deep traffic models as well as the widely used datasets, then build a standard benchmark to comprehensively evaluate their performances with the same settings and metrics. Our study named DL Traff is implemented with two most popular deep learning frameworks, i.e., TensorFlow and PyTorch, which is already publicly available as two GitHub repositories https github.com deepkashiwa20 DL Traff Grid and https github.com deepkashiwa20 DL Traff Graph. With DL Traff, we hope to deliver a useful resource to researchers who are interested in spatiotemporal data analysis.


Queues with Updating Information Finding the Amplitude of Oscillations. Many service systems provide customers with information about the system so that customers can make an informed decision about whether to join or not. Many of these systems provide information in the form of an update. Thus, the information about the system is updated periodically in increments of size Delta . It is known that these updates can cause oscillations in the resulting dynamics. However, it is an open problem to explicitly characterize the size of these oscillations when they occur. In this paper, we solve this open problem and show how to exactly calculate the amplitude of these oscillations via a fixed point equation. We also calculate closed form approximations via Taylor expansions of the fixed point equation and show that these approximations are very accurate, especially when Delta is large. Our analysis provides new insight for systems that use updates as a way of disseminating information to customers.


What Do Deep Nets Learn? Class wise Patterns Revealed in the Input Space. Deep neural networks (DNNs) are increasingly deployed in different applications to achieve state of the art performance. However, they are often applied as a black box with limited understanding of what knowledge the model has learned from the data. In this paper, we focus on image classification and propose a method to visualize and understand the class wise knowledge (patterns) learned by DNNs under three different settings including natural, backdoor and adversarial. Different to existing visualization methods, our method searches for a single predictive pattern in the pixel space to represent the knowledge learned by the model for each class. Based on the proposed method, we show that DNNs trained on natural (clean) data learn abstract shapes along with some texture, and backdoored models learn a suspicious pattern for the backdoored class. Interestingly, the phenomenon that DNNs can learn a single predictive pattern for each class indicates that DNNs can learn a backdoor even from clean data, and the pattern itself is a backdoor trigger. In the adversarial setting, we show that adversarially trained models tend to learn more simplified shape patterns. Our method can serve as a useful tool to better understand the knowledge learned by DNNs on different datasets under different settings.


PrivChain Provenance and Privacy Preservation in Blockchain enabled Supply Chains. Blockchain offers traceability and transparency to supply chain event data and hence can help overcome many challenges in supply chain management such as data integrity, provenance and traceability. However, data privacy concerns such as the protection of trade secrets have hindered adoption of blockchain technology. Although consortium blockchains only allow authorised supply chain entities to read write to the ledger, privacy preservation of trade secrets cannot be ascertained. In this work, we propose a privacy preservation framework, PrivChain, to protect sensitive data on blockchain using zero knowledge proofs. PrivChain provides provenance and traceability without revealing any sensitive information to end consumers or supply chain entities. Its novelty stems from a) its ability to allow data owners to protect trade related information and instead provide proofs on the data, and b) an integrated incentive mechanism for entities providing valid proofs over provenance data. In particular, PrivChain uses Zero Knowledge Range Proofs (ZKRPs), an efficient variant of ZKPs, to provide origin information without disclosing the exact location of a supply chain product. Furthermore, the framework allows to compute proofs and commitments off line, decoupling the computational overhead from blockchain. The proof verification process and incentive payment initiation are automated using blockchain transactions, smart contracts, and events. A proof of concept implementation on Hyperledger Fabric reveals a minimal overhead of using PrivChain for blockchain enabled supply chains.


Viking Variational Bayesian Variance Tracking. We consider the problem of time series forecasting in an adaptive setting. We focus on the inference of state space models under unknown and potentially time varying noise variances. We introduce an augmented model in which the variances are represented as auxiliary gaussian latent variables in a tracking mode. As variances are nonnegative, a transformation is chosen and applied to these latent variables. The inference relies on the online variational Bayesian methodology, which consists in minimizing a Kullback Leibler divergence at each time step. We observe that the minimum of the Kullback Leibler divergence is an extension of the Kalman filter taking into account the variance uncertainty. We design a novel algorithm, named Viking, using these optimal recursive updates. For auxiliary latent variables, we use second order bounds whose optimum admit closed form solutions. Experiments on synthetic data show that Viking behaves well and is robust to misspecification.


27.5 29.5 GHz Switched Array Sounder for Dynamic Channel Characterization Design, Implementation and Measurements. A pre requisite for the design of wireless systems is the understanding of the propagation channel. While a wealth of propagation knowledge exists for bands below 6 GHz, the same can not be said for bands approaching millimeter wave frequencies. In this paper, we present the design, implementation and measurement based verification of a re configurable 27.5 29.5 GHz channel sounder for measuring dynamic directional channels. Based on the switched array principle, our design is capable of characterizing 128 times 256 dual polarized channels with snapshot times of around 600 ms. This is in sharp contrast to measurement times on the order of tens of minutes with rotating horn antenna sounders. Our design lends itself to high angular resolution at both link ends with calibrated antenna arrays sampled at 2 circ and 5 circ intervals in the azimuth and elevation domains. This is complemented with a bandwidth of up to 2 GHz, enabling nanosecond level delay resolution. The short measurement times and stable radio frequency design facilitates real time processing and averaging of the received wavefronts to gain measurement signal to noise ratio and dynamic range. After disclosing the sounder design and implementation, we demonstrate its capabilities by presenting dynamic and static measurements at 28 GHz over a 1 GHz bandwidth in an office corridor environment.


Finite axiomatizability of logics of distributive lattices with negation. This paper focuses on order preserving logics defined from varieties of distributive lattices with negation, and in particular on the problem of whether these can be axiomatized by means of finite Hilbert calculi. On the side of negative results, we provide a syntactic condition on the equational presentation of a variety that entails failure of finite axiomatizability for the corresponding logic. An application of this result is that the logic of all distributive lattices with negation is not finitely axiomatizable likewise, we establish that the order preserving logic of the variety of all Ockham algebras is also not finitely axiomatizable. On the positive side, we show that an arbitrary subvariety of semi De Morgan algebras is axiomatized by a finite number of equations if and only if the corresponding order preserving logic is axiomatized by a finite Hilbert calculus. This equivalence also holds for every subvariety of a Berman variety of Ockham algebras. We obtain, as a corollary, a new proof that the implication free fragment of intuitionistic logic is finitely axiomatizable, as well as a new Hilbert calculus for it. Our proofs are constructive in that they allow us to effectively convert an equational presentation of a variety of algebras into a Hilbert calculus for the corresponding order preserving logic, and vice versa. We also consider the assertional logics associated to the above mentioned varieties, showing in particular that the assertional logics of finitely axiomatizable subvarieties of semi De Morgan algebras are finitely axiomatizable as well.


Explanations in Autonomous Driving A Survey. The automotive industry has witnessed an increasing level of development in the past decades from manufacturing manually operated vehicles to manufacturing vehicles with a high level of automation. With the recent developments in Artificial Intelligence (AI), automotive companies now employ blackbox AI models to enable vehicles to perceive their environments and make driving decisions with little or no input from a human. With the hope to deploy autonomous vehicles (AV) on a commercial scale, the acceptance of AV by society becomes paramount and may largely depend on their degree of transparency, trustworthiness, and compliance with regulations. The assessment of the compliance of AVs to these acceptance requirements can be facilitated through the provision of explanations for AVs' behaviour. Explainability is therefore seen as an important requirement for AVs. AVs should be able to explain what they have 'seen', done, and might do in environments in which they operate. In this paper, we provide a comprehensive survey of the existing body of work around explainable autonomous driving. First, we open with a motivation for explanations by highlighting and emphasising the importance of transparency, accountability, and trust in AVs and examining existing regulations and standards related to AVs. Second, we identify and categorise the different stakeholders involved in the development, use, and regulation of AVs and elicit their explanation requirements for AV. Third, we provide a rigorous review of previous work on explanations for the different AV operations (i.e., perception, localisation, planning, control, and system management). Finally, we identify pertinent challenges and provide recommendations, such as a conceptual framework for AV explainability. This survey aims to provide the fundamental knowledge required of researchers who are interested in explainability in AVs.


GCGE A Package for Solving Large Scale Eigenvalue Problems by Parallel Block Damping Inverse Power Method. We propose an eigensolver and the corresponding package, GCGE, for solving large scale eigenvalue problems. This method is the combination of damping idea, subspace projection method and inverse power method with dynamic shifts. To reduce the dimensions of projection subspaces, a moving mechanism is developed when the number of desired eigenpairs is large. The numerical methods, implementing techniques and the structure of the package are presented. Plenty of numerical results are provided to demonstrate the efficiency, stability and scalability of the concerned eigensolver and the package GCGE for computing many eigenpairs of large symmetric matrices arising from applications.


Statistics for Unimodal Sequences. We prove a number of limiting distributions for statistics for unimodal sequences of positive integers by adapting a probabilistic framework for integer partitions introduced by Fristedt. The difficulty in applying the direct analogue of Fristedt's techniques to unimodal sequences lies in the fact that the generating function for partitions is an infinite product, while that of unimodal sequences is not. Essentially, we get around this by conditioning on the size of the largest part and working uniformly on contributing summands. Our framework may be used to derive many distributions, and our results include joint distributions for largest parts and multiplicities of small parts. We discuss ranks as well. We further obtain analogous results for strongly unimodal sequences.


Multi modal Attention Network for Stock Movements Prediction. Stock prices move as piece wise trending fluctuation rather than a purely random walk. Traditionally, the prediction of future stock movements is based on the historical trading record. Nowadays, with the development of social media, many active participants in the market choose to publicize their strategies, which provides a window to glimpse over the whole market's attitude towards future movements by extracting the semantics behind social media. However, social media contains conflicting information and cannot replace historical records completely. In this work, we propose a multi modality attention network to reduce conflicts and integrate semantic and numeric features to predict future stock movements comprehensively. Specifically, we first extract semantic information from social media and estimate their credibility based on posters' identity and public reputation. Then we incorporate the semantic from online posts and numeric features from historical records to make the trading strategy. Experimental results show that our approach outperforms previous methods by a significant margin in both prediction accuracy (61.20 ) and trading profits (9.13 ). It demonstrates that our method improves the performance of stock movements prediction and informs future research on multi modality fusion towards stock prediction.


G invariant Spin Structures on Spheres. We examine which of the compact connected Lie groups that act transitively on spheres of different dimensions leave the unique spin structure of the sphere invariant. We study the notion of invariance of a spin structure and prove this classification in two different ways through examining the differential of the actions and through representation theory.


Global Tweet Mentions of COVID 19. Background. After a year and half and over 4 million deaths, the COVID 19 pandemic continues to be widespread, and its related topics continue to dominate the global media. Although COVID 19 diagnoses have been well monitored, neither the impacts of the disease on human behavior and social dynamics nor the effectiveness of policy interventions aimed at its containment are fully understood. Monitoring the spatial and temporal patterns of behavior, social dynamics and policy and then their interrelations can provide critical information for preparatory action and effective response. Methods. Here we present an open source dataset of 1.92 million keyword selected Twitter posts, updated weekly from January 2020 to present, along with a dynamic dashboard showing totals at national and subnational administrative divisions. Results. The dashboard presents 100 of the geotagged tweets that contain keywords or hashtags related COVID 19. We validated our inclusion criteria using a machine learning based text classifier and found that 88 of the selected tweets were correctly labeled as related to COVID 19. With this information we tested the correlation between tweets and covid diagnosis from January 1, 2020 through December 31, 2020 and see a decreasing correlation across time. Conclusions. With emerging COVID variants but ongoing vaccine hesitancy and resistance, this dataset could be used by researchers to study numerous aspects of COVID 19 and provide valuable insights for preparing future pandemics.


Eavesdropping with Intelligent Reflective Surfaces Threats and Defense Strategies. Intelligent reflecting surfaces (IRSs) have several prominent advantages, including improving the level of wireless communications security and privacy. In this work, we focus on this aspect and envision a strategy to counteract the presence of passive eavesdroppers overhearing transmissions from a base station towards legitimate users. Unlike most of the existing works addressing passive eavesdropping, the strategy we consider has low complexity and is suitable for scenarios where nodes are equipped with a limited number of antennas. Through our performance evaluation, we highlight the trade off between the legitimate users' data rate and secrecy rate, and how the system parameters affect such a trade off.


Learning Models as Functionals of Signed Distance Fields for Manipulation Planning. This work proposes an optimization based manipulation planning framework where the objectives are learned functionals of signed distance fields that represent objects in the scene. Most manipulation planning approaches rely on analytical models and carefully chosen abstractions state spaces to be effective. A central question is how models can be obtained from data that are not primarily accurate in their predictions, but, more importantly, enable efficient reasoning within a planning framework, while at the same time being closely coupled to perception spaces. We show that representing objects as signed distance fields not only enables to learn and represent a variety of models with higher accuracy compared to point cloud and occupancy measure representations, but also that SDF based models are suitable for optimization based planning. To demonstrate the versatility of our approach, we learn both kinematic and dynamic models to solve tasks that involve hanging mugs on hooks and pushing objects on a table. We can unify these quite different tasks within one framework, since SDFs are the common object representation. Video https youtu.be ga8Wlkss7co


Oblivious Stacking and MAX k CUT for Circle Graphs. Stacking is an important process within logistics. Some notable examples of items to be stacked are steel bars or steel plates in a steel yard or containers in a container terminal or on a ship. We say that two items are conflicting if their storage time intervals overlap in which case one of the items needs to be rehandled if the items are stored at the same LIFO storage location. We consider the problem of stacking items using k LIFO locations with a minimum number of conflicts between items sharing a location. We present an extremely simple online stacking algorithm that is oblivious to the storage time intervals and storage locations of all other items when it picks a storage location for an item. The risk of assigning the same storage location to two conflicting items is proved to be of the order 1 k 2 under mild assumptions on the distribution of the storage time intervals for the items. Intuitively, it seems natural to pick a storage location uniformly at random in the oblivious setting implying a risk of 1 k so the risk for our algorithm is surprisingly low. Our results can also be expressed within the context of the MAX k CUT problem for circle graphs. The results indicate that circle graphs on average have relatively big k cuts compared to the total number of edges.


u cf2vec Representation Learning for Personalized Algorithm Selection in Recommender Systems. Collaborative Filtering (CF) has become the standard approach to solve recommendation systems (RS) problems. Collaborative Filtering algorithms try to make predictions about interests of a user by collecting the personal interests from multiple users. There are multiple CF algorithms, each one of them with its own biases. It is the Machine Learning practitioner that has to choose the best algorithm for each task beforehand. In Recommender Systems, different algorithms have different performance for different users within the same dataset. Meta Learning (MtL) has been used to choose the best algorithm for a given problem. Meta Learning is usually applied to select algorithms for a whole dataset. Adapting it to select the to the algorithm for a single user in a RS involves several challenges. The most important is the design of the metafeatures which, in typical meta learning, characterize datasets while here, they must characterize a single user. This work presents a new meta learning based framework named mu cf2vec to select the best algorithm for each user. We propose using Representation Learning techniques to extract the metafeatures. Representation Learning tries to extract representations that can be reused in other learning tasks. In this work we also implement the framework using different RL techniques to evaluate which one can be more useful to solve this task. In the meta level, the meta learning model will use the metafeatures to extract knowledge that will be used to predict the best algorithm for each user. We evaluated an implementation of this framework using MovieLens 20M dataset. Our implementation achieved consistent gains in the meta level, however, in the base level we only achieved marginal gains.


The persistent, the anti persistent and the Brownian when does the Hurst exponent warn us of impending catastrophes?. The analogy between self similar time series with given Hurst exponent H and Markovian, Gaussian stochastic processes with multiplicative noise and entropic index q (Borland, PRE 57, 6, 6634 6642, 1998) allows us to explain the empirical results reported in (Pavithran et al., EPL, 129 2020 24004) and (Pavithran et al. Sci. Reports 10.1 (2020) 1 8) with the help of the properties of the nonextensive entropy Sq of index q a dominant oscillating mode arises as H goes to zero in many different systems and its amplitude is proportional to 1 H 2 . Thus, a decrease of H acts as precursor of large oscillations of the state variable, which corresponds to catastrophic events in many problems of practical interest. In contrast, if H goes to 1 then the time series is strongly intermittent, fluctuations of the state variable follow a power law whose exponent depends on H, and exceedingly large event are basically unpredictable. These predictions agree with observations in problems of aeroacoustics, aeroelasticity, electric engineering, hydrology, laser physics, meteorology, plasma physics, plasticity, polemology, seismology and thermoacoustics.


Learning Based Proximity Matrix Factorization for Node Embedding. Node embedding learns a low dimensional representation for each node in the graph. Recent progress on node embedding shows that proximity matrix factorization methods gain superb performance and scale to large graphs with millions of nodes. Existing approaches first define a proximity matrix and then learn the embeddings that fit the proximity by matrix factorization. Most existing matrix factorization methods adopt the same proximity for different tasks, while it is observed that different tasks and datasets may require different proximity, limiting their representation power. Motivated by this, we propose em Lemane , a framework with trainable proximity measures, which can be learned to best suit the datasets and tasks at hand automatically. Our method is end to end, which incorporates differentiable SVD in the pipeline so that the parameters can be trained via backpropagation. However, this learning process is still expensive on large graphs. To improve the scalability, we train proximity measures only on carefully subsampled graphs, and then apply standard proximity matrix factorization on the original graph using the learned proximity. Note that, computing the learned proximities for each pair is still expensive for large graphs, and existing techniques for computing proximities are not applicable to the learned proximities. Thus, we present generalized push techniques to make our solution scalable to large graphs with millions of nodes. Extensive experiments show that our proposed solution outperforms existing solutions on both link prediction and node classification tasks on almost all datasets.


Protection or punishment? relating the design space of parental control apps and perceptions about them to support parenting for online safety. Parental control apps, which are mobile apps that allow parents to monitor and restrict their children's activities online, are becoming increasingly adopted by parents as a means of safeguarding their children's online safety. However, it is not clear whether these apps are always beneficial or effective in what they aim to do for instance, the overuse of restriction and surveillance has been found to undermine parent child relationship and children's sense of autonomy. In this work, we investigate this gap, asking specifically how might children's and parents' perceptions be related to how parental control features were designed? To investigate this question, we conducted an analysis of 58 top Android parental control apps designed for the purpose of promoting children's online safety, finding three major axes of variation in how key restriction and monitoring features were realised granularity, feedback transparency, and parent child communications support. To relate these axes to perceived benefits and problems, we then analysed 3264 app reviews to identify references to aspects of the each of the axes above, to understand children's and parents' views of how such dimensions related to their experiences with these apps. Our findings led towards 1) an understanding of how parental control apps realise their functionalities differently along three axes of variation, 2) an analysis of exactly the ways that such variation influences children's and parents' perceptions, respectively of the usefulness or effectiveness of these apps, and finally 3) an identification of design recommendations and opportunities for future apps by contextualising our findings within existing digital parenting theories.


Secure Virtual Mobile Small Cells A Stepping Stone Towards 6G. As 5th Generation research reaches the twilight, the research community must go beyond 5G and look towards the 2030 connectivity landscape, namely 6G. In this context, this work takes a step towards the 6G vision by proposing a next generation communication platform, which aims to extend the rigid coverage area of fixed deployment networks by considering virtual mobile small cells (MSC) that are created on demand. Relying on emerging computing paradigms such as NFV (Network Function Virtualization) and SDN (Software Defined Networking), these cells can harness radio and networking capability locally reducing protocol signaling latency and overhead. These MSCs constitute an intelligent pool of networking resources that can collaborate to form a wireless network of MSCs providing a communication platform for localized, ubiquitous and reliable connectivity. The technology enablers for implementing the MSC concept are also addressed in terms of virtualization, lightweight wireless security, and energy efficient RF. The benefits of the MSC architecture towards reliable and efficient cell offloading are demonstrated as a use case.


Categorical actions and derived equivalences for finite odd dimensional orthogonal groups. In this paper we prove that Brou ' e 's abelian defect group conjecture is true for the finite odd dimensional orthogonal groups SO 2n 1 (q), with q odd, at odd linear primes. We first make use of the reduction theorem of Bonnaf ' e Dat Rouquier to reduce the problem to isolated blocks. Then we construct a categorical action of a Kac Moody algebra on the category of quadratic unipotent representations of the various groups SO 2n 1 (q) in non defining characteristic, by extending the corresponding work of Dudas Varagnolo Vasserot for unipotent representations. This is one of the main ingredients of our work which might be of independent interest. To obtain derived equivalences of blocks and their Brauer correspondents, we turn to investigate a special kind of blocks, called isolated Rouquier blocks. Finally, the desired derived equivalence is guaranteed by the work of Chuang Rouquier showing that categorical actions provide derived equivalences between weight spaces, which are exactly the isolated blocks in our situation.


Multiple Object Tracking with Correlation Learning. Recent works have shown that convolutional networks have substantially improved the performance of multiple object tracking by simultaneously learning detection and appearance features. However, due to the local perception of the convolutional network structure itself, the long range dependencies in both the spatial and temporal cannot be obtained efficiently. To incorporate the spatial layout, we propose to exploit the local correlation module to model the topological relationship between targets and their surrounding environment, which can enhance the discriminative power of our model in crowded scenes. Specifically, we establish dense correspondences of each spatial location and its context, and explicitly constrain the correlation volumes through self supervised learning. To exploit the temporal context, existing approaches generally utilize two or more adjacent frames to construct an enhanced feature representation, but the dynamic motion scene is inherently difficult to depict via CNNs. Instead, our paper proposes a learnable correlation operator to establish frame to frame matches over convolutional feature maps in the different layers to align and propagate temporal context. With extensive experimental results on the MOT datasets, our approach demonstrates the effectiveness of correlation learning with the superior performance and obtains state of the art MOTA of 76.5 and IDF1 of 73.6 on MOT17.


APEX A High Performance Learned Index on Persistent Memory. The recently released persistent memory (PM) offers high performance, persistence, and is cheaper than DRAM. This opens up new possibilities for indexes that operate and persist data directly on the memory bus. Recent learned indexes exploit data distribution and have shown great potential for some workloads. However, none support persistence or instant recovery, and existing PM based indexes typically evolve B trees without considering learned indexes. This paper proposes APEX, a new PM optimized learned index that offers high performance, persistence, concurrency, and instant recovery. APEX is based on ALEX, a state of the art updatable learned index, to combine and adapt the best of past PM optimizations and learned indexes, allowing it to reduce PM accesses while still exploiting machine learning. Our evaluation on Intel DCPMM shows that APEX can perform up to 15x better than existing PM indexes and can recover from failures in 42ms.


Random batch method for multi species stochastic interacting particle systems. A random batch method for multi species interacting particle systems is proposed, extending the method of S. Jin, L. Li, and J. G. Liu J. Comput. Phys. 400 (2020), 108877 . The idea of the algorithmus is to randomly divide, at each time step, the ensemble of particles into small batches and then to evolve the interaction of each particle within the batches until the next time step. This reduces the computational cost by one order of magnitude, while keeping a certain accuracy. It is proved that the L 2 error of the error process behaves like the square root of the time step size, uniformly in time, thus providing the convergence of the scheme. The numerical efficiency is tested for some examples, and numerical simulations of the opinion dynamics in a hierarchical company, consisting of workers, managers, and CEOs, are presented.


Game theoretic approach to H " o lder regularity for PDEs involving eigenvalues of the Hessian. We prove a local H " o lder estimate with an exponent 0 delta frac 12 for solutions of the dynamic programming principle u varepsilon (x) sum j 1 n alpha j inf dim(S) j sup substack v in S v 1 frac u varepsilon (x varepsilon v) u varepsilon (x varepsilon v) 2 . The proof is based on a new coupling idea from game theory. As an application, we get the same regularity estimate for viscosity solutions of the PDE sum i 1 n alpha i lambda i(D 2u) 0, where lambda 1(D 2 u) leq cdots leq lambda n(D 2 u) are the eigenvalues of the Hessian.


LCTR On Awakening the Local Continuity of Transformer for Weakly Supervised Object Localization. Weakly supervised object localization (WSOL) aims to learn object localizer solely by using image level labels. The convolution neural network (CNN) based techniques often result in highlighting the most discriminative part of objects while ignoring the entire object extent. Recently, the transformer architecture has been deployed to WSOL to capture the long range feature dependencies with self attention mechanism and multilayer perceptron structure. Nevertheless, transformers lack the locality inductive bias inherent to CNNs and therefore may deteriorate local feature details in WSOL. In this paper, we propose a novel framework built upon the transformer, termed LCTR (Local Continuity TRansformer), which targets at enhancing the local perception capability of global features among long range feature dependencies. To this end, we propose a relational patch attention module (RPAM), which considers cross patch information on a global basis. We further design a cue digging module (CDM), which utilizes local features to guide the learning trend of the model for highlighting the weak local responses. Finally, comprehensive experiments are carried out on two widely used datasets, ie, CUB 200 2011 and ILSVRC, to verify the effectiveness of our method.


Explain Me the Painting Multi Topic Knowledgeable Art Description Generation. Have you ever looked at a painting and wondered what is the story behind it? This work presents a framework to bring art closer to people by generating comprehensive descriptions of fine art paintings. Generating informative descriptions for artworks, however, is extremely challenging, as it requires to 1) describe multiple aspects of the image such as its style, content, or composition, and 2) provide background and contextual knowledge about the artist, their influences, or the historical period. To address these challenges, we introduce a multi topic and knowledgeable art description framework, which modules the generated sentences according to three artistic topics and, additionally, enhances each description with external knowledge. The framework is validated through an exhaustive analysis, both quantitative and qualitative, as well as a comparative human evaluation, demonstrating outstanding results in terms of both topic diversity and information veracity.


Off diagonal estimates for bilinear commutators. We find a minimal notion of non degeneracy for bilinear singular integral operators T and identify testing conditions on the multiplying function b that characterize the L p times L q to L r, 1 p,q infty and r frac 1 2 , boundedness of the bilinear commutator b,T 1(f,g) bT(f,g) T(bf,g). Our arguments cover almost all arrangements of the integrability exponents p,q,r, with a single open problem presented in the end. Additionally, the arguments extend to the multilinear setting.


Observation of Nonlinear Dynamics in an Optical Levitation System. Optical levitation of mechanical oscillators has been suggested as a promising way to decouple the environmental noise and increase the mechanical quality factor. Here, we investigate the dynamics of a free standing mirror acting as the top reflector of a vertical optical cavity, designed as a testbed for a tripod cavity optical levitation setup. To reach the regime of levitation for a milligram scale mirror, the optical intensity of the intracavity optical field approaches 3 MW cm 2 . We identify three distinct optomechanical effects excitation of acoustic vibrations, expansion due to photothermal absorption, and partial lift off of the mirror due to radiation pressure force. These effects are intercoupled via the intracavity optical field and induce complex system dynamics inclusive of high order sideband generation, optical bistability, parametric amplification, and the optical spring effect. We modify the response of the mirror with active feedback control to improve the overall stability of the system.


Arbitrary Conditional Distributions with Energy. Modeling distributions of covariates, or density estimation, is a core challenge in unsupervised learning. However, the majority of work only considers the joint distribution, which has limited utility in practical situations. A more general and useful problem is arbitrary conditional density estimation, which aims to model any possible conditional distribution over a set of covariates, reflecting the more realistic setting of inference based on prior knowledge. We propose a novel method, Arbitrary Conditioning with Energy (ACE), that can simultaneously estimate the distribution p( mathbf x u mid mathbf x o) for all possible subsets of unobserved features mathbf x u and observed features mathbf x o . ACE is designed to avoid unnecessary bias and complexity we specify densities with a highly expressive energy function and reduce the problem to only learning one dimensional conditionals (from which more complex distributions can be recovered during inference). This results in an approach that is both simpler and higher performing than prior methods. We show that ACE achieves state of the art for arbitrary conditional likelihood estimation and data imputation on standard benchmarks.


Bohr Rogosinski and improved Bohr type inequalities for certain fully starlike harmonic mappings. The classical Bohr inequality states that if f is an analytic function with the power series representation f(z) sum n 0 infty a nz n in the unit disk mathbb D z in mathbb C z 1 such that f(z) leq 1 for all z in mathbb D , then begin equation sum n 0 infty a n r n leq 1 text for z r leq frac 1 3 end equation and the constant 1 3 cannot be improved. The constant r 0 1 3 is known as Bohr radius and the inequality sum n 0 infty a n r n leq 1 is known as Bohr inequality. Let mathcal H be the class of complex valued harmonic mappings f h bar g defined in the unit disk mathbb D , where h and g are analytic functions in mathbb D with the normalization h(0) 0 h prime (0) 1 and g(0) 0 . Let mathcal H 0 f h bar g in mathcal H g prime (0) 0 . Let mathcal P 0 mathcal H (M) f h overline g in mathcal H 0 real (zh prime prime (z)) M zg prime prime (z) , z in mathbb D , M 0 . Functions in the class mathcal P 0 mathcal H (M) are called fully starlike univalent functions for 0 M 1 log 4 . In this paper, we obtain the sharp Bohr Rogosinski type inequality and improved Bohr inequality and the corresponding Bohr radius for the class mathcal P mathcal H 0 (M) .


BGT Net Bidirectional GRU Transformer Network for Scene Graph Generation. Scene graphs are nodes and edges consisting of objects and object object relationships, respectively. Scene graph generation (SGG) aims to identify the objects and their relationships. We propose a bidirectional GRU (BiGRU) transformer network (BGT Net) for the scene graph generation for images. This model implements novel object object communication to enhance the object information using a BiGRU layer. Thus, the information of all objects in the image is available for the other objects, which can be leveraged later in the object prediction step. This object information is used in a transformer encoder to predict the object class as well as to create object specific edge information via the use of another transformer encoder. To handle the dataset bias induced by the long tailed relationship distribution, softening with a log softmax function and adding a bias adaptation term to regulate the bias for every relation prediction individually showed to be an effective approach. We conducted an elaborate study on experiments and ablations using open source datasets, i.e., Visual Genome, Open Images, and Visual Relationship Detection datasets, demonstrating the effectiveness of the proposed model over state of the art.


Group based Distinctive Image Captioning with Memory Attention. Describing images using natural language is widely known as image captioning, which has made consistent progress due to the development of computer vision and natural language generation techniques. Though conventional captioning models achieve high accuracy based on popular metrics, i.e., BLEU, CIDEr, and SPICE, the ability of captions to distinguish the target image from other similar images is under explored. To generate distinctive captions, a few pioneers employ contrastive learning or re weighted the ground truth captions, which focuses on one single input image. However, the relationships between objects in a similar image group (e.g., items or properties within the same album or fine grained events) are neglected. In this paper, we improve the distinctiveness of image captions using a Group based Distinctive Captioning Model (GdisCap), which compares each image with other images in one similar group and highlights the uniqueness of each image. In particular, we propose a group based memory attention (GMA) module, which stores object features that are unique among the image group (i.e., with low similarity to objects in other images). These unique object features are highlighted when generating captions, resulting in more distinctive captions. Furthermore, the distinctive words in the ground truth captions are selected to supervise the language decoder and GMA. Finally, we propose a new evaluation metric, distinctive word rate (DisWordRate) to measure the distinctiveness of captions. Quantitative results indicate that the proposed method significantly improves the distinctiveness of several baseline models, and achieves the state of the art performance on both accuracy and distinctiveness. Results of a user study agree with the quantitative evaluation and demonstrate the rationality of the new metric DisWordRate.


Prime values of a sparse polynomial sequence. A distinguishing feature of certain intractable problems in prime number theory is the sparsity of the underlying sequence. Motivated by the general problem of finding primes in sparse polynomial sequences, we give an estimate for the number of primes of the shape x 3 2y 3 where y is small.


Control for autonomous vehicles in collision avoidance maneuvers LPV modeling and static feedback controller. This article presents a state feedback control design strategy for the stabilization of a vehicle along a reference collision avoidance maneuver. The stabilization of the vehicle is achieved through a combination of steering, acceleration and braking. A Linear Parameter Varying (LPV) model is obtained from the linearization of a non linear model along the reference trajectory. A robust state feedback control law is computed for the LPV model. Finally, simulation results illustrate the stabilization of the vehicle along the reference trajectory.


Constructions of Binary Cross Z Complementary Pairs With Large CZC Ratio. Cross Z complementary pairs (CZCPs) are a special kind of Z complementary pairs (ZCPs) having zero autocorrelation sums around the in phase position and end shift position, also having zero cross correlation sums around the end shift position. It can be utilized as a key component in designing optimal training sequences for broadband spatial modulation (SM) systems over frequency selective channels. In this paper, we focus on designing new CZCPs with large cross Z complementary ratio ( mathrm CZC mathrm ratio ) by exploring two promising approaches. The first one of CZCPs via properly cascading sequences from a Golay complementary pair (GCP). The proposed construction leads to (28L,13L) mathrm CZCPs , (28L,13L frac L 2 ) mathrm CZCPs and (30L,13L 1) mathrm CZCPs , where L is the length of a binary GCP. Besides, we emphasize that, our proposed CZCPs have the largest mathrm CZC mathrm ratio frac 27 28 , compared with known CZCPs but no perfect CZCPs in the literature. Specially, we proposed optimal binary CZCPs with (28,13) mathrm CZCP and (56,27) mathrm CZCP . The second one of CZCPs based on Boolean functions (BFs), and the construction of CZCPs have the largest mathrm CZC mathrm ratio frac 13 14 , compared with known CZCPs but no perfect CZCPs in the literature.


BERT Learns to Teach Knowledge Distillation with Meta Learning. We present Knowledge Distillation with Meta Learning (MetaDistil), a simple yet effective alternative to traditional knowledge distillation (KD) methods where the teacher model is fixed during training. We show the teacher network can learn to better transfer knowledge to the student network (i.e., learning to teach) with the feedback from the performance of the distilled student network in a meta learning framework. Moreover, we introduce a pilot update mechanism to improve the alignment between the inner learner and meta learner in meta learning algorithms that focus on an improved inner learner. Experiments on various benchmarks show that MetaDistil can yield significant improvements compared with traditional KD algorithms and is less sensitive to the choice of different student capacity and hyperparameters, facilitating the use of KD on different tasks and models.


On signed graphs with at most two eigenvalues unequal to pm 1 . We present the first steps towards the determination of the signed graphs for which the adjacency matrix has all but at most two eigenvalues equal to 1 or 1. Here we deal with the disconnected, the bipartite and the complete signed graphs. In addition, we present many examples which cannot be obtained from an unsigned graph or its negative by switching.


On the rank of Z 2 matrices with free entries on the diagonal. For an n times n matrix M with entries in mathbb Z 2 denote by R(M) the minimal rank of all the matrices obtained by changing some numbers on the main diagonal of M . We prove that for each non negative integer k there is a polynomial in n algorithm deciding whether R(M) leq k (whose complexity may depend on k ). We also give a polynomial in n algorithm computing a number m such that m 2 leq R(M) leq m . These results have applications to graph drawings on non orientable surfaces.


Homoclinic tangencies leading to robust heterodimensional cycles. We consider C r ( r geqslant 1 ) diffeomorphisms f defined on manifolds of dimension geqslant 3 with homoclinic tangencies associated to saddles. Under generic properties, we show that if the saddle is homoclinically related to a blender then the diffeomorphism f can be C r approximated by diffeomorphisms with C 1 robust heterodimensional cycles. As an application, we show that the classic Simon Asaoka's examples of diffeomorphisms with C 1 robust homoclinic tangencies also display C 1 robust heterodimensional cycles. In a second application, we consider homoclinic tangencies associated to hyperbolic sets. When the entropy of these sets is large enough we obtain C 1 robust cycles after C 1 perturbations.


Effective and Privacy preserving Tabular Data Synthesizing. While data sharing is crucial for knowledge development, privacy concerns and strict regulation (e.g., European General Data Protection Regulation (GDPR)) unfortunately limits its full effectiveness. Synthetic tabular data emerges as an alternative to enable data sharing while fulfilling regulatory and privacy constraints. The state of the art tabular data synthesizers draw methodologies from Generative Adversarial Networks (GAN). In this thesis, we develop CTAB GAN, a novel conditional table GAN architecture that can effectively model diverse data types with complex distributions. CTAB GAN is extensively evaluated with the state of the art GANs that generate synthetic tables, in terms of data similarity and analysis utility. The results on five datasets show that the synthetic data of CTAB GAN remarkably resembles the real data for all three types of variables and results in higher accuracy for five machine learning algorithms, by up to 17 . Additionally, to ensure greater security for training tabular GANs against malicious privacy attacks, differential privacy (DP) is studied and used to train CTAB GAN with strict privacy guarantees. DP CTAB GAN is rigorously evaluated using state of the art DP tabular GANs in terms of data utility and privacy robustness against membership and attribute inference attacks. Our results on three datasets indicate that strict theoretical differential privacy guarantees come only after severely affecting data utility. However, it is shown empirically that these guarantees help provide a stronger defence against privacy attacks. Overall, it is found that DP CTABGAN is capable of being robust to privacy attacks while maintaining the highest data utility as compared to prior work, by up to 18 in terms of the average precision score.


Local and 2 local derivations of simple n ary algebras. In the present paper, we prove that every local and 2 local derivation of the complex finite dimensional simple Filippov algebra is a derivation. As a corollary we have the description of all local and 2 local derivations of complex finite dimensional semisimple Filippov algebras. All local derivations of the ternary Malcev algebra M 8 are described. It is the first example of a finite dimensional simple algebra that admits pure local derivations, i.e. algebra admits a local derivation which is not a derivation.


Decoding of Reed Muller Codes Starting With a Higher Rate Constituent Code. List versions of recursive decoding are known to approach maximum likelihood (ML) performance for the short length Reed Muller (RM) codes. The recursive decoder employs the Plotkin construction to split the original code into two shorter RM codes, with a lower rate RM code being decoded first. In this paper, we consider non iterative soft input decoders for RM codes that, unlike recursive decoding, start decoding with a higher rate constituent code. Although the error rate performance of these algorithms is limited, it can be significantly improved by applying permutations from the automorphism group of the code, with permutations being selected on the fly based on soft information from a channel. Simulation results show that the error rate performance of the proposed algorithms enhanced by a permutation selection technique is close to that of the automorphism based recursive decoding algorithm with similar complexity for short length ( leq 256) RM codes, while our decoders perform better for longer RM codes. In particular, it is demonstrated that the proposed algorithms achieve near ML performance for RM codes of length 2 m and order m 3 with reasonable complexity.


Site Selective Dynamics of Ligand Free and Ligand Bound Azidolysozyme. Azido modified alanine residues (AlaN 3 ) are environment sensitive, minimally invasive infrared probes for the site specific investigation of protein structure and dynamics. Here, the capability of the label is investigated to query whether or not a ligand is bound to the active site of Lysozyme and how the spectroscopy and dynamics change upon ligand binding. The results demonstrate specific differences for center frequencies of the asymmetric azide stretch vibration, the long time decay and the static offset of the frequency fluctuation correlation function all of which are experimental observables between the ligand free and the ligand bound, N 3 labelled protein. Changes in dynamics can also be mapped onto changes in the local and through space coupling between residues by virtue of dynamical cross correlation maps. This makes the azide label a versatile and structurally sensitive probe to report on the dynamics of proteins in a variety of environments and for a range of different applications.


The Low Resource Double Bind An Empirical Study of Pruning for Low Resource Machine Translation. A "bigger is better" explosion in the number of parameters in deep neural networks has made it increasingly challenging to make state of the art networks accessible in compute restricted environments. Compression techniques have taken on renewed importance as a way to bridge the gap. However, evaluation of the trade offs incurred by popular compression techniques has been centered on high resource datasets. In this work, we instead consider the impact of compression in a data limited regime. We introduce the term low resource double bind to refer to the co occurrence of data limitations and compute resource constraints. This is a common setting for NLP for low resource languages, yet the trade offs in performance are poorly studied. Our work offers surprising insights into the relationship between capacity and generalization in data limited regimes for the task of machine translation. Our experiments on magnitude pruning for translations from English into Yoruba, Hausa, Igbo and German show that in low resource regimes, sparsity preserves performance on frequent sentences but has a disparate impact on infrequent ones. However, it improves robustness to out of distribution shifts, especially for datasets that are very distinct from the training distribution. Our findings suggest that sparsity can play a beneficial role at curbing memorization of low frequency attributes, and therefore offers a promising solution to the low resource double bind.


The continuous dependence and non uniform dependence of the rotation Camassa Holm equation in Besov spaces. In this paper, we first establish the local well posedness and continuous dependence for the rotation Camassa Holm equation modelling the equatorial water waves with the weak Coriolis effect in nonhomogeneous Besov spaces B s p,r with s 1 1 p or s 1 1 p, p in 1, infty), r 1 by a new way the compactness argument and Lagrangian coordinate transformation, which removes the index constraint s 3 2 and improves our previous work cite guoy1 . Then, we prove the solution is not uniformly continuous dependence on the initial data in both supercritical and critical Besov spaces.


On pseudo horizontal surfaces and mathbb Z 2 Thurston norms in small Seifert 3 manifolds. We give a criterion for the existence for pseudo horizontal surfaces in small Seifert fibered manifolds. We calculate the genuses for such surfaces and detect their mathbb Z 2 homology classes. Using such pseudo horizontal surfaces, we can determine the mathbb Z 2 Thurston norm for every mathbb Z 2 homology classes in small Seifert manifolds. We find several families of examples that in the same mathbb Z 2 homology class the genus of a pseudo horizontal surface is less than the genus of the pseudo vertical surface. Hence the pseudo vertical surfaces is not mathbb Z 2 taut.


Long Term Exploration in Persistent MDPs. Exploration is an essential part of reinforcement learning, which restricts the quality of learned policy. Hard exploration environments are defined by huge state space and sparse rewards. In such conditions, an exhaustive exploration of the environment is often impossible, and the successful training of an agent requires a lot of interaction steps. In this paper, we propose an exploration method called Rollback Explore (RbExplore), which utilizes the concept of the persistent Markov decision process, in which agents during training can roll back to visited states. We test our algorithm in the hard exploration Prince of Persia game, without rewards and domain knowledge. At all used levels of the game, our agent outperforms or shows comparable results with state of the art curiosity methods with knowledge based intrinsic motivation ICM and RND. An implementation of RbExplore can be found at https github.com cds mipt RbExplore.


Plasmoid mediated reconnection during nonlinear peeling ballooning edge localized modes. Plasmoid mediated reconnection is investigated for nonlinear Peeling Ballooning Edge Localized Modes (P B ELMs). The formation of current sheets and the transition to 3 D current sheet instability is demonstrated through fully nonlinear resistive MHD simulations of P B ELMs in DIII D discharges. Large scale axisymmetric current sheets, as well as small scale poloidally extending current sheets, are formed as the coherent P B ELM filaments nonlinearly evolve. It is observed that, at high Lundquist numbers, these current sheets break during a reconnection burst, i.e. a secondary exponential growth of intermediate modes followed by relaxation due to the suppression of P B drive.


The stable representations of mathrm GL N over finite local principal ideal rings. Let mathcal O be a discrete valuation ring with unique maximal ideal mathfrak p and with finite residue field mathbb F q , the field with q elements where q is a power of a prime p . For r ge 1 , we write mathcal O r for the reduction of mathcal O modulo the ideal mathfrak p r . An irreducible representation of the finite group G r mathrm GL N ( mathcal O r ) is called stable if its restriction to the principal congruence kernel K l 1 mathfrak p l mathrm M N ( mathcal O r) , where l frac r 1 2 , consists of representations whose stabilisers modulo K l' are centralisers of Jordan canonical matrix in mathfrak g l' mathrm M N ( mathcal O l' ) , where l' r l . Their study is motivated by constructions of strongly semisimple representations, introduced by the work of Hill, which is a special case of stable representations. In this paper, we explore the construction of stable (ordinary) irreducible representations of the finite group G r mathrm GL N ( mathcal O r ) for N ge 2 .


Deep Spiking Convolutional Neural Network for Single Object Localization Based On Deep Continuous Local Learning. With the advent of neuromorphic hardware, spiking neural networks can be a good energy efficient alternative to artificial neural networks. However, the use of spiking neural networks to perform computer vision tasks remains limited, mainly focusing on simple tasks such as digit recognition. It remains hard to deal with more complex tasks (e.g. segmentation, object detection) due to the small number of works on deep spiking neural networks for these tasks. The objective of this paper is to make the first step towards modern computer vision with supervised spiking neural networks. We propose a deep convolutional spiking neural network for the localization of a single object in a grayscale image. We propose a network based on DECOLLE, a spiking model that enables local surrogate gradient based learning. The encouraging results reported on Oxford IIIT Pet validates the exploitation of spiking neural networks with a supervised learning approach for more elaborate vision tasks in the future.


Examining Covert Gender Bias A Case Study in Turkish and English Machine Translation Models. As Machine Translation (MT) has become increasingly more powerful, accessible, and widespread, the potential for the perpetuation of bias has grown alongside its advances. While overt indicators of bias have been studied in machine translation, we argue that covert biases expose a problem that is further entrenched. Through the use of the gender neutral language Turkish and the gendered language English, we examine cases of both overt and covert gender bias in MT models. Specifically, we introduce a method to investigate asymmetrical gender markings. We also assess bias in the attribution of personhood and examine occupational and personality stereotypes through overt bias indicators in MT models. Our work explores a deeper layer of bias in MT models and demonstrates the continued need for language specific, interdisciplinary methodology in MT model development.


LINDA Unsupervised Learning to Interpolate in Natural Language Processing. Despite the success of mixup in data augmentation, its applicability to natural language processing (NLP) tasks has been limited due to the discrete and variable length nature of natural languages. Recent studies have thus relied on domain specific heuristics and manually crafted resources, such as dictionaries, in order to apply mixup in NLP. In this paper, we instead propose an unsupervised learning approach to text interpolation for the purpose of data augmentation, to which we refer as "Learning to INterpolate for Data Augmentation" (LINDA), that does not require any heuristics nor manually crafted resources but learns to interpolate between any pair of natural language sentences over a natural language manifold. After empirically demonstrating the LINDA's interpolation capability, we show that LINDA indeed allows us to seamlessly apply mixup in NLP and leads to better generalization in text classification both in domain and out of domain.


On homology torsion growth. We prove new vanishing results on the growth of higher torsion homologies for suitable arithmetic lattices, Artin groups and mapping class groups. The growth is understood along Farber sequences, in particular, along residual chains. For principal congruence subgroups, we also obtain strong asymptotic bounds for the torsion growth. As a central tool, we introduce a quantitative homotopical method called effective rebuilding. This constructs small classifying spaces of finite index subgroups, at the same time controlling the complexity of the homotopy. The method easily applies to free abelian groups and then extends recursively to a wide class of residually finite groups.


Accounting for Variations in Speech Emotion Recognition with Nonparametric Hierarchical Neural Network. In recent years, deep learning based speech emotion recognition models have outperformed classical machine learning models. Previously, neural network designs, such as Multitask Learning, have accounted for variations in emotional expressions due to demographic and contextual factors. However, existing models face a few constraints 1) they rely on a clear definition of domains (e.g. gender, noise condition, etc.) and the availability of domain labels 2) they often attempt to learn domain invariant features while emotion expressions can be domain specific. In the present study, we propose the Nonparametric Hierarchical Neural Network (NHNN), a lightweight hierarchical neural network model based on Bayesian nonparametric clustering. In comparison to Multitask Learning approaches, the proposed model does not require domain task labels. In our experiments, the NHNN models generally outperform the models with similar levels of complexity and state of the art models in within corpus and cross corpus tests. Through clustering analysis, we show that the NHNN models are able to learn group specific features and bridge the performance gap between groups.


A Dynamic Programming Formulation for the Nonlinear Filter. This paper build on our recent work where we presented a dual stochastic optimal control formulation of the nonlinear filtering problem 1 . The constraint for the dual problem is a backward stochastic differential equations (BSDE). The solution is obtained via an application of the maximum principle (MP). In the present paper, a dynamic programming (DP) principle is presented for a special class of BSDE constrained stochastic optimal control problems. The principle is applied to derive the solution of the nonlinear filtering problem.


Can You Trust Your Trust Measure?. Trust in human robot interactions (HRI) is measured in two main ways through subjective questionnaires and through behavioral tasks. To optimize measurements of trust through questionnaires, the field of HRI faces two challenges the development of standardized measures that apply to a variety of robots with different capabilities, and the exploration of social and relational dimensions of trust in robots (e.g., benevolence). In this paper we look at how different trust questionnaires fare given these challenges that pull in different directions (being general vs. being exploratory) by studying whether people think the items in these questionnaires are applicable to different kinds of robots and interactions. In Study 1 we show that after being presented with a robot (non humanoid) and an interaction scenario (fire evacuation), participants rated multiple questionnaire items such as "This robot is principled" as "Non applicable to robots in general" or "Non applicable to this robot". In Study 2 we show that the frequency of these ratings change (indeed, even for items rated as N A to robots in general) when a new scenario is presented (game playing with a humanoid robot). Finally, while overall trust scores remained robust to N A ratings, our results revealed potential fallacies in the way these scores are commonly interpreted. We conclude with recommendations for the development, use and results reporting of trust questionnaires for future studies, as well as theoretical implications for the field of HRI.


A multi orthogonal polynomials' approach to bulk queueing theory. We consider a stationary Markov process that models certain queues with a bulk service of fixed number m of admitted customers. We find an integral expression of its transition probability function in terms of certain multi orthogonal polynomials. We study the convergence of the appropriate scheme of simultaneous quadrature rules to design an algorithm for computing this integral expression.


Finite 0 dimensional multiprojective schemes and their ideals. We study finite 0 dimensional schemes in product of multiprojective spaces and their ideals. In particular, we describe the set of generators of the ideal defining a 0 dimensional scheme in the case mathbb P 1 times cdots times mathbb P 1 and in the case mathbb P n 1 times cdots times mathbb P n k with n i in 1,2 for all i . We also check very ampleness for zero dimensional schemes of general points in the multiprojective spaces.


On p adic L functions for GL 2n in finite slope Shalika families. In this paper, we prove new results on the geometry of the cuspidal eigenvariety for mathrm GL 2n over a totally real number field F at classical points admitting Shalika models. We also construct p adic L functions over the eigenvariety around these points. Our proofs proceed in the opposite direction to established methods rather than using the geometry of eigenvarieties to deduce results about p adic L functions, we instead show that via evaluation maps on parahoric overconvergent cohomology groups non vanishing of a p adic L function implies smoothness of the eigenvariety at such points. More precisely, we attach a p adic L function to a non critical refinement tilde pi of a regular algebraic cuspidal automorphic representation pi of mathrm GL 2n F which is spherical at p and admits a Shalika model. This gives the first construction of p adic L functions in this generality beyond the p ordinary setting. Further, when pi has regular weight and the corresponding p adic Galois representation is irreducible, we show that the parabolic eigenvariety for mathrm GL 2n F is 'etale at tilde pi over an ( F mathbb Q 1) dimensional weight space and contains a dense set of classical points admitting Shalika models. Finally, under a hypothesis on the local Shalika models at bad places which is empty for pi of level 1, we construct a p adic L function for the family.


On the Optimality of the Oja's Algorithm for Online PCA. In this paper we analyze the behavior of the Oja's algorithm for online streaming principal component subspace estimation. It is proved that with high probability it performs an efficient, gap free, global convergence rate to approximate an principal component subspace for any sub Gaussian distribution. Moreover, it is the first time to show that the convergence rate, namely the upper bound of the approximation, exactly matches the lower bound of an approximation obtained by the offline classical PCA up to a constant factor.


Improving perturbation theory for open shell molecules via self consistency. We present an extension of our one body M o ller Plesset second order perturbation (OBMP2) method for open shell systems. We derived the OBMP2 Hamiltonian through the canonical transformation followed by the cumulant approximation to reduce many body operators into one body ones. The resulting Hamiltonian consists of an uncorrelated Fock (unperturbed Hamiltonian) and a one body correlation potential (perturbed Hamiltonian) composed of only double excitations. Molecular orbitals and associated energy levels are then relaxed via self consistency, similar to Hartree Fock, in the presence of the correlation at the MP2 level. We demonstrate the OBMP2 performance by considering two examples well known for requiring orbital optimization bond breaking and isotropic hyperfine coupling constants. In contrast to non iterative MP2, we show that OBMP2 can yield a smooth transition through the unrestriction point and accurately predict isotropic hyperfine coupling constants.


grenepipe A flexible, scalable, and reproducible pipeline to automate variant and frequency calling from sequence reads. Processing high throughput DNA sequencing data of individuals or populations requires stringing together independent software tools with many parameters, often leading to non reproducible pipelines and datasets. We developed grenepipe to streamline this data processing, an all in one Snakemake workflow from raw sequencing data to the end product of a table of individuals' genotypes or population frequencies. Our pipeline allows users to select among a range of popular software tools within a single configuration file, automatically downloads and installs software and dependencies, and runs with two command calls to prepare and to run. It is highly optimized for scalability in cluster environments and parallel computing, splitting data tasks into manageable genomic sections and automatically consolidating the outputs. grenepipe is published under the GPL 3 license, and freely available at https github.com moiexpositoalonsolab grenepipe.


Viscous flow fields in hyperelastic Chambers. Viscous flows in hyperelastic chambers are relevant to many biological phenomena such as inhalation into the lung's acinar region and medical applications such as the inflation of a small chamber in minimally invasive procedures. In this work, we analytically study the viscous flow and elastic deformation created due to inflation of such spherical chambers from one or two inlets. Our investigation considers the shell's constitutive hyperelastic law coupled with the flow dynamics inside the chamber. For the case of a narrow tube filling a larger chamber, the pressure within the chamber involves a large spatially uniform part, and a small order correction. We derive a closed form expression for the inflation dynamics, accounting for the effect of elastic bi stability. Interestingly, the obtained pressure distribution shows that the maximal pressure on the chamber's surface is greater than the pressure at the entrance to the chamber. The calculated series solution of the velocity and pressure fields during inflation is verified by using a fully coupled finite element scheme, resulting in excellent agreement. Our results allow estimating the chamber's viscous resistance at different pressures, thus enabling us to model the process of inflation and deflation.


Local stability of McKean Vlasov equations arising from heterogeneous Gibbs systems using limit of relative entropies. A family of heterogeneous mean field systems with jumps is analyzed. These systems are constructed as a Gibbs measure on block graphs. When the total number of particles goes to infinity, a law of large numbers is shown to hold in a multi class context resulting in the weak convergence of the empirical vector towards the solution of a McKean Vlasov system of equations. We then investigate the local stability of the limiting McKean Vlasov system through the construction of a local Lyapunov function. We first compute the limit of adequately scaled relative entropy functions associated with the explicit stationary distribution of the N particles system. Using a Laplace principle for empirical vectors we show that the limit takes an explicit form. Then we demonstrate that this limit satisfies a descent property which, combined with some mild assumptions shows that it is indeed a local Lyapunov function.


Contradiction from the Fixed Point Lemma. This paper argues that the Fixed Point Lemma implies that contradiction is derivable within primitive recursive arithmetic (PRA). Since PRA is consistent, this is regarded as a paradox to be resolved. The argument is inspired by the v Curry paradox, but we utilize only a syntactic notion of derivability, not a semantic notion such as validity. The new paradox could be blocked by excluding certain formulae from the scope of the Fixed Point Lemma, but this would effectively concede that the unrestricted Lemma is false. The resolution of the paradox thus remains an open question.


Heights on stacks and a generalized Batyrev Manin Malle conjecture. We define a notion of height for rational points with respect to a vector bundle on a proper algebraic stack with finite diagonal over a global field, which generalizes the usual notion for rational points on projective varieties. We explain how to compute this height for various stacks of interest (for instance classifying stacks of finite groups, symmetric products of varieties, moduli stacks of abelian varieties, weighted projective spaces). In many cases our uniform definition reproduces ways already in use for measuring the complexity of rational points, while in others it is something new. Finally, we formulate a conjecture about the number of rational points of bounded height (in our sense) on a stack X, which specializes to the Baytev Manin conjecture when X is a scheme and to Malle's conjecture when X is the classifying stack of a finite group.


Bounds on half graph orders in powers of sparse graphs. Half graphs and their variants, such as ladders, semi ladders and co matchings, are combinatorial objects that encode total orders in graphs. Works by Adler and Adler (Eur. J. Comb. 2014) and Fabia 'nski et al. (STACS 2019) prove that in the powers of sparse graphs, one cannot find arbitrarily large objects of this kind. However, these proofs either are non constructive, or provide only loose upper bounds on the orders of half graphs and semi ladders. In this work we provide nearly tight asymptotic lower and upper bounds on the maximum order of half graphs, parameterized on the distance, in the following classes of sparse graphs planar graphs, graphs with bounded maximum degree, graphs with bounded pathwidth or treewidth, and graphs excluding a fixed clique as a minor. The most significant part of our work is the upper bound for planar graphs. Here, we employ techniques of structural graph theory to analyze semi ladders in planar graphs through the notion of cages, which expose a topological structure in semi ladders. As an essential building block of this proof, we also state and prove a new structural result, yielding a fully polynomial bound on the neighborhood complexity in the class of planar graphs.


Multi Period Portfolio Optimization using Model Predictive Control with Mean Variance and Risk Parity Frameworks. We employ model predictive control for a multi period portfolio optimization problem. In addition to the mean variance objective, we construct a portfolio whose allocation is given by model predictive control with a risk parity objective, and provide a successive convex program algorithm that provides 30 times faster and robust solutions in the experiments. Computational results on the multi asset universe show that multi period models perform better than their single period counterparts in out of sample period, 2006 2020. The out of sample risk adjusted performance of both mean variance and risk parity formulations beat the fix mix benchmark, and achieve Sharpe ratio of 0.64 and 0.97, respectively.


Bi level Feature Alignment for Versatile Image Translation and Manipulation. Generative adversarial networks (GANs) have achieved great success in image translation and manipulation. However, high fidelity image generation with faithful style control remains a grand challenge in computer vision. This paper presents a versatile image translation and manipulation framework that achieves accurate semantic and style guidance in image generation by explicitly building a correspondence. To handle the quadratic complexity incurred by building the dense correspondences, we introduce a bi level feature alignment strategy that adopts a top k operation to rank block wise features followed by dense attention between block features which reduces memory cost substantially. As the top k operation involves index swapping which precludes the gradient propagation, we propose to approximate the non differentiable top k operation with a regularized earth mover's problem so that its gradient can be effectively back propagated. In addition, we design a novel semantic position encoding mechanism that builds up coordinate for each individual semantic region to preserve texture structures while building correspondences. Further, we design a novel confidence feature injection module which mitigates mismatch problem by fusing features adaptively according to the reliability of built correspondences. Extensive experiments show that our method achieves superior performance qualitatively and quantitatively as compared with the state of the art. The code is available at href https github.com fnzhan RABIT https github.com fnzhan RABIT .


Superfast Coloring in CONGEST via Efficient Color Sampling. We present a procedure for efficiently sampling colors in the congest model. It allows nodes whose number of colors exceeds their number of neighbors by a constant fraction to sample up to Theta( log n) semi random colors unused by their neighbors in O(1) rounds, even in the distance 2 setting. This yields algorithms with O( log Delta) complexity for different edge coloring, vertex coloring, and distance 2 coloring problems, matching the best possible. In particular, we obtain an O( log Delta) round CONGEST algorithm for (1 epsilon) Delta edge coloring when Delta ge log 1 1 log n n , and a poly( log log n ) round algorithm for (2 Delta 1) edge coloring in general. The sampling procedure is inspired by a seminal result of Newman in communication complexity.


Joint Location and Communication Study for Intelligent Reflecting Surface Aided Wireless Communication System. Intelligent reflecting surface (IRS) is a novel burgeoning concept, which possesses advantages in enhancing wireless communication and user localization, while maintaining low hardware cost and energy consumption. Herein, we establish an IRS aided mmWave MIMO based joint localization and communication system (IMM JLCS), and probe into its performance evaluation and optimization design. Specifically, first, we provide the signal, channel and estimation error models, and contrive the working process of the IMM JLCS in detail. Then, by configuring appropriate IRS phase shifts, we derive the closed form expressions of the Cramer Rao Lower Bound (CRLB) of the position orientation estimation errors and the effective achievable data rate (EADR), with respect to the time allocation ratio of the beam alignment and localization stage (BALS). Subsequently, we investigate the trade off between the two performance metrics, for which we propose a joint optimization algorithm. Finally, we carry out simulations and comparisons to view the trade off and validate the effectiveness of the proposed algorithm, in the presence of distinct levels of estimation uncertainty and user mobility. Our results demonstrate that the proposed algorithm can find the joint optimal solution for the position orientation estimation accuracy and EADR, with its optimization performance being robust to slight localization or channel estimation errors and user mobility.


Interpolation and approximation via Momentum ResNets and Neural ODEs. In this article, we explore the effects of memory terms in continuous layer Deep Residual Networks by studying Neural ODEs (NODEs). We investigate two types of models. On one side, we consider the case of Residual Neural Networks with dependence on multiple layers, more precisely Momentum ResNets. On the other side, we analyze a Neural ODE with auxiliary states playing the role of memory states. We examine the interpolation and universal approximation properties for both architectures through a simultaneous control perspective. We also prove the ability of the second model to represent sophisticated maps, such as parametrizations of time dependent functions. Numerical simulations complement our study.


EGGS Eigen Gap Guided Search For Automated Spectral Clustering. The performance of spectral clustering heavily relies on the quality of affinity matrix. A variety of affinity matrix construction (AMC) methods have been proposed but they have hyperparameters to determine beforehand, which requires strong experience and lead to difficulty in real applications especially when the inter cluster similarity is high or and the dataset is large. In addition, we often need to choose different AMC methods for different datasets, which still depends on experience. To solve these two challenging problems, in this paper, we present a simple yet effective method for automated spectral clustering. The main idea is to find the most reliable affinity matrix among a set of candidates given by different AMC methods with different hyperparameters, where the reliability is quantified by the textit relative eigen gap of graph Laplacian introduced in this paper. We also implement the method using Bayesian optimization.We extend the method to large scale datasets such as MNIST, on which the time cost is less than 90s and the clustering accuracy is state of the art. Extensive experiments of natural image clustering show that our method is more versatile, accurate, and efficient than baseline methods.


Segmentation of cell level anomalies in electroluminescence images of photovoltaic modules. In the operation maintenance (O M) of photovoltaic (PV) plants, the early identification of failures has become crucial to maintain productivity and prolong components' life. Of all defects, cell level anomalies can lead to serious failures and may affect surrounding PV modules in the long run. These fine defects are usually captured with high spatial resolution electroluminescence (EL) imaging. The difficulty of acquiring such images has limited the availability of data. For this work, multiple data resources and augmentation techniques have been used to surpass this limitation. Current state of the art detection methods extract barely low level information from individual PV cell images, and their performance is conditioned by the available training data. In this article, we propose an end to end deep learning pipeline that detects, locates and segments cell level anomalies from entire photovoltaic modules via EL images. The proposed modular pipeline combines three deep learning techniques 1. object detection (modified Faster RNN), 2. image classification (EfficientNet) and 3. weakly supervised segmentation (autoencoder). The modular nature of the pipeline allows to upgrade the deep learning models to the further improvements in the state of the art and also extend the pipeline towards new functionalities.