Semantic Representation and Inference for NLP. Semantic representation and inference is essential for Natural Language Processing (NLP). The state of the art for semantic representation and inference is deep learning, and particularly Recurrent Neural Networks (RNNs), Convolutional Neural Networks (CNNs), and transformer Self Attention models. This thesis investigates the use of deep learning for novel semantic representation and inference, and makes contributions in the following three areas creating training data, improving semantic representations and extending inference learning. In terms of creating training data, we contribute the largest publicly available dataset of real life factual claims for the purpose of automatic claim verification (MultiFC), and we present a novel inference model composed of multi scale CNNs with different kernel sizes that learn from external sources to infer fact checking labels. In terms of improving semantic representations, we contribute a novel model that captures non compositional semantic indicators. By definition, the meaning of a non compositional phrase cannot be inferred from the individual meanings of its composing words (e.g., hot dog). Motivated by this, we operationalize the compositionality of a phrase contextually by enriching the phrase representation with external word embeddings and knowledge graphs. Finally, in terms of inference learning, we propose a series of novel deep learning architectures that improve inference by using syntactic dependencies, by ensembling role guided attention heads, incorporating gating layers, and concatenating multiple heads in novel and effective ways. This thesis consists of seven publications (five published and two under review).


Constructing Contrastive samples via Summarization for Text Classification with limited annotations. Contrastive Learning has emerged as a powerful representation learning method and facilitates various downstream tasks especially when supervised data is limited. How to construct efficient contrastive samples through data augmentation is key to its success. Unlike vision tasks, the data augmentation method for contrastive learning has not been investigated sufficiently in language tasks. In this paper, we propose a novel approach to construct contrastive samples for language tasks using text summarization. We use these samples for supervised contrastive learning to gain better text representations which greatly benefit text classification tasks with limited annotations. To further improve the method, we mix up samples from different classes and add an extra regularization, named Mixsum, in addition to the cross entropy loss. Experiments on real world text classification datasets (Amazon 5, Yelp 5, AG News, and IMDb) demonstrate the effectiveness of the proposed contrastive learning framework with summarization based data augmentation and Mixsum regularization.


A Self Explainable Stylish Image Captioning Framework via Multi References. In this paper, we propose to build a stylish image captioning model through a Multi style Multi modality mechanism (2M). We demonstrate that with 2M, we can build an effective stylish captioner and that multi references produced by the model can also support explaining the model through identifying erroneous input features on faulty examples. We show how this 2M mechanism can be used to build stylish captioning models and show how these models can be utilized to provide explanations of likely errors in the models.


An efficient algorithm for deciding vanishing of Schubert polynomial coefficients. Schubert polynomials form a basis of all polynomials and appear in the study of cohomology rings of flag manifolds. The vanishing problem for Schubert polynomials asks if a coefficient of a Schubert polynomial is zero. We give a tableau criterion to solve this problem, from which we deduce the first polynomial time algorithm. These results are obtained from new characterizations of the Schubitope, a generalization of the permutahedron defined for any subset of the n x n grid. In contrast, we show that computing these coefficients explicitly is P complete.


On the correlation of angular distributions of keV ions and trajectory dependent electronic excitations in transmission channelling geometry. We use energy discrimination of keV ions transmitted through a thin, single crystalline silicon membrane to correlate specific angular distribution patterns formed in channelling geometry with trajectory dependent electronic energy loss. The integral energy and intensity distribution of transmitted ions can thus be dissected into on one side axially channelled projectiles travelling along rather straight trajectories and on the other side dechannelled projectiles predominantly experiencing blocking. Angular distributions of transmitted ions are further simulated with two different Monte Carlo codes.


Reconsidering CO2 emissions from Computer Vision. Climate change is a pressing issue that is currently affecting and will affect every part of our lives. It's becoming incredibly vital we, as a society, address the climate crisis as a universal effort, including those in the Computer Vision (CV) community. In this work, we analyze the total cost of CO2 emissions by breaking it into (1) the architecture creation cost and (2) the life time evaluation cost. We show that over time, these costs are non negligible and are having a direct impact on our future. Importantly, we conduct an ethical analysis of how the CV community is unintentionally overlooking its own ethical AI principles by emitting this level of CO2. To address these concerns, we propose adding "enforcement" as a pillar of ethical AI and provide some recommendations for how architecture designers and broader CV community can curb the climate crisis.


Encoding sinusoidal functions in hybrid automata formalism. Hybrid systems can express a plethora of physical phenomena and systems as they can combine continuous and discrete dynamics. There exist several tools that enable the reachability analysis of hybrid systems modeled as hybrid automata. However, these tools exhibit certain limitations in the type of mathematical operations that they natively support. For example, SpaceEx, a well established tool in the hybrid verification community, supports the use of linear ODEs in the flow of each discrete location. Mathematical functions like algebraic equations or trigonometric functions have to be encoded as the solutions of a set of ODEs. In this article, we provide a mechanism to define sinusoidal functions that are supported by SpaceEx. We also show how certain Simulink blocks can be translated into hybrid automata.


Local Intrinsic Dimensionality Signals Adversarial Perturbations. The vulnerability of machine learning models to adversarial perturbations has motivated a significant amount of research under the broad umbrella of adversarial machine learning. Sophisticated attacks may cause learning algorithms to learn decision functions or make decisions with poor predictive performance. In this context, there is a growing body of literature that uses local intrinsic dimensionality (LID), a local metric that describes the minimum number of latent variables required to describe each data point, for detecting adversarial samples and subsequently mitigating their effects. The research to date has tended to focus on using LID as a practical defence method often without fully explaining why LID can detect adversarial samples. In this paper, we derive a lower bound and an upper bound for the LID value of a perturbed data point and demonstrate that the bounds, in particular the lower bound, has a positive correlation with the magnitude of the perturbation. Hence, we demonstrate that data points that are perturbed by a large amount would have large LID values compared to unperturbed samples, thus justifying its use in the prior literature. Furthermore, our empirical validation demonstrates the validity of the bounds on benchmark datasets.


Fiber entropy and algorithmic complexity of random orbits. We consider a finite set of measure preserving transformations (T theta ) theta in Theta acting on a probability space (X, mu) , which are choosen randomly according to an ergodic stochastic process ( Theta mathbb N , nu, sigma) . This describes a paradigmatic case of a random dynamical system (RDS). Considering a finite partition mathcal P of X we show that the conditional algorithmic complexity of a random orbit x, T alpha 0 (x),T alpha 1 circ T alpha 0 (x), ... in X relative to the sequence alpha alpha 0 alpha 1 alpha 2 ... in Theta mathbb N equals almost surely the fiber entropy of the RDS with respect to mathcal P , whenever the latter is ergodic. This extends a classical result of A. Brudno connecting algorithmic complexity and entropy in deterministic dynamical systems.


The Electric Vehicle Routing Problem with Nonlinear Charging Functions. This paper outlines an exact and a heuristic algorithm for the electric vehicle routing problem with a nonlinear charging function (E VRP NL) introduced by Montoya et al. (2017). The E VRP NL captures several realistic features of electric vehicles including the battery limited driving range and nonlinear charging process at the charging stations. We formulate this problem as a set partitioning and solve it using a column generation based algorithm. The resulting pricing problem of the column generation is a complicated problem as, next to the usual operational constraints e.g. time windows and vehicle capacity, electric vehicle related features are also considered. In particular, the nonlinear nature of the battery charging process requires the incorporation of a set of sophisticated recursive functions in the pricing algorithm. We show how these recursive functions allow for the simultaneous evaluation of the routing and charging decisions. Moreover, we illustrate how they can efficiently be embedded in the pricing algorithm. The column generation algorithm is integrated in a branch and bound algorithm and cutting planes are added resulting in a branch and price and cut algorithm for the E VRP NL. Next to the exact algorithm, we also develop a tabu search based heuristic to solve the problem quickly. To prove the efficiency of the proposed algorithms, their performance is tested on benchmark instances from the literature. Our exact algorithm can optimally solve instances with up to 40 customers, including several instances previously unsolved to optimality. The tabu search heuristic proves to be superior to state of the art heuristics in the literature both on solution quality and computation times.


Few shot Controllable Style Transfer for Low Resource Multilingual Settings. Style transfer is the task of rewriting a sentence into a target style while approximately preserving content. While most prior literature assumes access to a large style labelled corpus, recent work (Riley et al. 2021) has attempted "few shot" style transfer using only 3 10 sentences at inference for style extraction. In this work we study a relevant low resource setting style transfer for languages where no style labelled corpora are available. We notice that existing few shot methods perform this task poorly, often copying inputs verbatim. We push the state of the art for few shot style transfer with a new method modeling the stylistic difference between paraphrases. When compared to prior work, our model achieves 2 3x better performance in formality transfer and code mixing addition across seven languages. Moreover, our method is better at controlling the style transfer magnitude using an input scalar knob. We report promising qualitative results for several attribute transfer tasks (sentiment transfer, simplification, gender neutralization, text anonymization) all without retraining the model. Finally, we find model evaluation to be difficult due to the lack of datasets and metrics for many languages. To facilitate future research we crowdsource formality annotations for 4000 sentence pairs in four Indic languages, and use this data to design our automatic evaluations.


Vehicle trajectory prediction in top view image sequences based on deep learning method. Annually, a large number of injuries and deaths around the world are related to motor vehicle accidents. This value has recently been reduced to some extent, via the use of driver assistance systems. Developing driver assistance systems (i.e., automated driving systems) can play a crucial role in reducing this number. Estimating and predicting surrounding vehicles' movement is essential for an automated vehicle and advanced safety systems. Moreover, predicting the trajectory is influenced by numerous factors, such as drivers' behavior during accidents, history of the vehicle's movement and the surrounding vehicles, and their position on the traffic scene. The vehicle must move over a safe path in traffic and react to other drivers' unpredictable behaviors in the shortest time. Herein, to predict automated vehicles' path, a model with low computational complexity is proposed, which is trained by images taken from the road's aerial image. Our method is based on an encoder decoder model that utilizes a social tensor to model the effect of the surrounding vehicles' movement on the target vehicle. The proposed model can predict the vehicle's future path in any freeway only by viewing the images related to the history of the target vehicle's movement and its neighbors. Deep learning was used as a tool for extracting the features of these images. Using the HighD database, an image dataset of the road's aerial image was created, and the model's performance was evaluated on this new database. We achieved the RMSE of 1.91 for the next 5 seconds and found that the proposed method had less error than the best path prediction methods in previous studies.


Strong Brascamp Lieb Inequalities. In this paper, we derive sharp nonlinear dimension free Brascamp Lieb inequalities (including hypercontractivity inequalities) for distributions on Polish spaces, which strengthen the classic Brascamp Lieb inequalities. Applications include the extension of Mrs. Gerber's lemma to the cases of R 'enyi divergences and distributions on Polish spaces, the strengthening of small set expansion theorems, and the characterization of the exponent of the q stability. Our proofs in this paper are based on information theoretic and coupling techniques.


Choosing the Right Algorithm With Hints From Complexity Theory. Choosing a suitable algorithm from the myriads of different search heuristics is difficult when faced with a novel optimization problem. In this work, we argue that the purely academic question of what could be the best possible algorithm in a certain broad class of black box optimizers can give fruitful indications in which direction to search for good established optimization heuristics. We demonstrate this approach on the recently proposed DLB benchmark, for which the only known results are O(n 3) runtimes for several classic evolutionary algorithms and an O(n 2 log n) runtime for an estimation of distribution algorithm. Our finding that the unary unbiased black box complexity is only O(n 2) suggests the Metropolis algorithm as an interesting candidate and we prove that it solves the DLB problem in quadratic time. Since we also prove that better runtimes cannot be obtained in the class of unary unbiased algorithms, we shift our attention to algorithms that use the information of more parents to generate new solutions. An artificial algorithm of this type having an O(n log n) runtime leads to the result that the significance based compact genetic algorithm (sig cGA) can solve the DLB problem also in time O(n log n) . Our experiments show a remarkably good performance of the Metropolis algorithm, clearly the best of all algorithms regarded for reasonable problem sizes.


Learning Emergent Discrete Message Communication for Cooperative Reinforcement Learning. Communication is a important factor that enables agents work cooperatively in multi agent reinforcement learning (MARL). Most previous work uses continuous message communication whose high representational capacity comes at the expense of interpretability. Allowing agents to learn their own discrete message communication protocol emerged from a variety of domains can increase the interpretability for human designers and other agents.This paper proposes a method to generate discrete messages analogous to human languages, and achieve communication by a broadcast and listen mechanism based on self attention. We show that discrete message communication has performance comparable to continuous message communication but with much a much smaller vocabulary size.Furthermore, we propose an approach that allows humans to interactively send discrete messages to agents.


GraphFM Graph Factorization Machines for Feature Interaction Modeling. Factorization machine (FM) is a prevalent approach to modeling pairwise (second order) feature interactions when dealing with high dimensional sparse data. However, on the one hand, FM fails to capture higher order feature interactions suffering from combinatorial expansion, on the other hand, taking into account interaction between every pair of features may introduce noise and degrade prediction accuracy. To solve the problems, we propose a novel approach Graph Factorization Machine (GraphFM) by naturally representing features in the graph structure. In particular, a novel mechanism is designed to select the beneficial feature interactions and formulate them as edges between features. Then our proposed model which integrates the interaction function of FM into the feature aggregation strategy of Graph Neural Network (GNN), can model arbitrary order feature interactions on the graph structured features by stacking layers. Experimental results on several real world datasets has demonstrated the rationality and effectiveness of our proposed approach.


Evaluating Deep Graph Neural Networks. Graph Neural Networks (GNNs) have already been widely applied in various graph mining tasks. However, they suffer from the shallow architecture issue, which is the key impediment that hinders the model performance improvement. Although several relevant approaches have been proposed, none of the existing studies provides an in depth understanding of the root causes of performance degradation in deep GNNs. In this paper, we conduct the first systematic experimental evaluation to present the fundamental limitations of shallow architectures. Based on the experimental results, we answer the following two essential questions (1) what actually leads to the compromised performance of deep GNNs (2) when we need and how to build deep GNNs. The answers to the above questions provide empirical insights and guidelines for researchers to design deep and well performed GNNs. To show the effectiveness of our proposed guidelines, we present Deep Graph Multi Layer Perceptron (DGMLP), a powerful approach (a paradigm in its own right) that helps guide deep GNN designs. Experimental results demonstrate three advantages of DGMLP 1) high accuracy it achieves state of the art node classification performance on various datasets 2) high flexibility it can flexibly choose different propagation and transformation depths according to graph size and sparsity 3) high scalability and efficiency it supports fast training on large scale graphs. Our code is available in https github.com zwt233 DGMLP.


Gradual Fine Tuning for Low Resource Domain Adaptation. Fine tuning is known to improve NLP models by adapting an initial model trained on more plentiful but less domain salient examples to data in a target domain. Such domain adaptation is typically done using one stage of fine tuning. We demonstrate that gradually fine tuning in a multi stage process can yield substantial further gains and can be applied without modifying the model or learning objective.


Regular dessins with moduli fields of the form mathbb Q ( zeta p, sqrt p q ) . Gareth Jones asked during the 2014 SIGMAP conference for examples of regular dessins with nonabelian fields of moduli. In this paper, we first construct dessins whose moduli fields are nonabelian Galois extensions of the form mathbb Q ( zeta p, sqrt p q ) , where p is an odd prime and zeta p is a p th root of unity and q in mathbb Q is not a p th power, and we then show that their regular closures have the same moduli fields. Finally, in the special case p q 3 we give another example of a regular dessin with moduli field mathbb Q ( zeta 3, sqrt 3 3 ) of degree 2 19 cdot3 4 and genus 14155777 .


Toward Designing Social Human Robot Interactions for Deep Space Exploration. In planning for future human space exploration, it is important to consider how to design for uplifting interpersonal communications and social dynamics among crew members. What if embodied social robots could help to improve the overall team interaction experience in space? On Earth, social robots have been shown effective in providing companionship, relieving stress and anxiety, fostering connection among people, enhancing team performance, and mediating conflicts in human groups. In this paper, we introduce a set of novel research questions exploring social human robot interactions in long duration space exploration missions.


Multi GeV electron bunches from an all optical laser wakefield accelerator. We present the first demonstration of multi GeV laser wakefield acceleration in a fully optically formed plasma waveguide, with an acceleration gradient as high as 25 GeV m. The guide was formed via self waveguiding of 15 J, 45 fs ( 300 TW) pulses over 20 cm in a low density hydrogen gas jet, with accelerated electron bunches simultaneously driven up to 5 GeV in a milliradian divergence quasi monoenergetic peak of relative energy width 15 and charge of at least 10 picocoulombs. Energy gain is inversely correlated with on axis waveguide density in the range N e0 (1.3 3.2)x10 17 cm ( 3). We find that shot to shot stability of bunch spectra and charge are strongly dependent on the pointing of the injected laser pulse and gas jet uniformity. We also observe evidence of pump depletion induced dephasing, a consequence of the long optical guiding distance.


Botcha Detecting Malicious Non Human Traffic in the Wild. Malicious bots make up about a quarter of all traffic on the web, and degrade the performance of personalization and recommendation algorithms that operate on e commerce sites. Positive Unlabeled learning (PU learning) provides the ability to train a binary classifier using only positive (P) and unlabeled (U) instances. The unlabeled data comprises of both positive and negative classes. It is possible to find labels for strict subsets of non malicious actors, e.g., the assumption that only humans purchase during web sessions, or clear CAPTCHAs. However, finding signals of malicious behavior is almost impossible due to the ever evolving and adversarial nature of bots. Such a set up naturally lends itself to PU learning. Unfortunately, standard PU learning approaches assume that the labeled set of positives are a random sample of all positives, this is unlikely to hold in practice. In this work, we propose two modifications to PU learning that make it more robust to violations of the selected completely at random assumption, leading to a system that can filter out malicious bots. In one public and one proprietary dataset, we show that proposed approaches are better at identifying humans in web data than standard PU learning methods.


Subgame perfect Equilibria in Mean payoff Games. In this paper, we provide an effective characterization of all the subgame perfect equilibria in infinite duration games played on finite graphs with mean payoff objectives. To this end, we introduce the notion of requirement, and the notion of negotiation function. We establish that the plays that are supported by SPEs are exactly those that are consistent with the least fixed point of the negotiation function. Finally, we show that the negotiation function is piecewise linear, and can be analyzed using the linear algebraic tool box. As a corollary, we prove the decidability of the SPE constrained existence problem, whose status was left open in the literature.


Out of Distribution Robustness in Deep Learning Compression. In recent years, deep neural network (DNN) compression systems have proved to be highly effective for designing source codes for many natural sources. However, like many other machine learning systems, these compressors suffer from vulnerabilities to distribution shifts as well as out of distribution (OOD) data, which reduces their real world applications. In this paper, we initiate the study of OOD robust compression. Considering robustness to two types of ambiguity sets (Wasserstein balls and group shifts), we propose algorithmic and architectural frameworks built on two principled methods one that trains DNN compressors using distributionally robust optimization (DRO), and the other which uses a structured latent code. Our results demonstrate that both methods enforce robustness compared to a standard DNN compressor, and that using a structured code can be superior to the DRO compressor. We observe tradeoffs between robustness and distortion and corroborate these findings theoretically for a specific class of sources.


A derived Gabriel Popescu theorem for t structures via derived injectives. We prove a derived version of the Gabriel Popescu theorem in the framework of dg categories and t structures. This exhibits any pretriangulated dg category with a suitable t structure (such that its heart is a Grothendieck abelian category) as a t exact localization of a derived dg category of dg modules. We give an original proof based on a generalization of Mitchell's argument in "A quick proof of the Gabriel Popesco theorem" and involving derived injective objects. As an application, we also give a short proof that derived categories of Grothendieck abelian categories have a unique dg enhancement.


Stochastic Learning Rate Optimization in the Stochastic Approximation and Online Learning Settings. In this work, multiplicative stochasticity is applied to the learning rate of stochastic optimization algorithms, giving rise to stochastic learning rate schemes. In expectation theoretical convergence results of Stochastic Gradient Descent equipped with this novel stochastic learning rate scheme under the stochastic setting, as well as convergence results under the online optimization settings are provided. Empirical results consider the case of an adaptively uniformly distributed multiplicative stochasticity and include not only Stochastic Gradient Descent, but also other popular algorithms equipped with a stochastic learning rate. They demonstrate noticeable optimization performance gains, with respect to their deterministic learning rate versions.


Generalized Wasserstein barycenters between probability measures living on different subspaces. In this paper, we introduce a generalization of the Wasserstein barycenter, to a case where the initial probability measures live on different subspaces of R d. We study the existence and uniqueness of this barycenter, we show how it is related to a larger multi marginal optimal transport problem, and we propose a dual formulation. Finally, we explain how to compute numerically this generalized barycenter on discrete distributions, and we propose an explicit solution for Gaussian distributions.


Aesthetic Photo Collage with Deep Reinforcement Learning. Photo collage aims to automatically arrange multiple photos on a given canvas with high aesthetic quality. Existing methods are based mainly on handcrafted feature optimization, which cannot adequately capture high level human aesthetic senses. Deep learning provides a promising way, but owing to the complexity of collage and lack of training data, a solution has yet to be found. In this paper, we propose a novel pipeline for automatic generation of aspect ratio specified collage and the reinforcement learning technique is introduced in collage for the first time. Inspired by manual collages, we model the collage generation as sequential decision process to adjust spatial positions, orientation angles, placement order and the global layout. To instruct the agent to improve both the overall layout and local details, the reward function is specially designed for collage, considering subjective and objective factors. To overcome the lack of training data, we pretrain our deep aesthetic network on a large scale image aesthetic dataset (CPC) for general aesthetic feature extraction and propose an attention fusion module for structural collage feature representation. We test our model against competing methods on two movie datasets and our results outperform others in aesthetic quality evaluation. Further user study is also conducted to demonstrate the effectiveness.


Going Deeper in Frequency Convolutional Neural Network A Theoretical Perspective. Convolutional neural network (CNN) is one of the most widely used successful architectures in the era of deep learning. However, the high computational cost of CNN still hampers more universal uses to light devices. Fortunately, the Fourier transform on convolution gives an elegant and promising solution to dramatically reduce the computation cost. Recently, some studies devote to such a challenging problem and pursue the complete frequency computation without any switching between spatial domain and frequent domain. In this work, we revisit the Fourier transform theory to derive feed forward and back propagation frequency operations of typical network modules such as convolution, activation and pooling. Due to the calculation limitation of complex numbers on most computation tools, we especially extend the Fourier transform to the Laplace transform for CNN, which can run in the real domain with more relaxed constraints. This work more focus on a theoretical extension and discussion about frequency CNN, and lay some theoretical ground for real application.


CREW Computation Reuse and Efficient Weight Storage for Hardware accelerated MLPs and RNNs. Deep Neural Networks (DNNs) have achieved tremendous success for cognitive applications. The core operation in a DNN is the dot product between quantized inputs and weights. Prior works exploit the weight input repetition that arises due to quantization to avoid redundant computations in Convolutional Neural Networks (CNNs). However, in this paper we show that their effectiveness is severely limited when applied to Fully Connected (FC) layers, which are commonly used in state of the art DNNs, as it is the case of modern Recurrent Neural Networks (RNNs) and Transformer models. To improve energy efficiency of FC computation we present CREW, a hardware accelerator that implements Computation Reuse and an Efficient Weight Storage mechanism to exploit the large number of repeated weights in FC layers. CREW first performs the multiplications of the unique weights by their respective inputs and stores the results in an on chip buffer. The storage requirements are modest due to the small number of unique weights and the relatively small size of the input compared to convolutional layers. Next, CREW computes each output by fetching and adding its required products. To this end, each weight is replaced offline by an index in the buffer of unique products. Indices are typically smaller than the quantized weights, since the number of unique weights for each input tends to be much lower than the range of quantized weights, which reduces storage and memory bandwidth requirements. Overall, CREW greatly reduces the number of multiplications and provides significant savings in model memory footprint and memory bandwidth usage. We evaluate CREW on a diverse set of modern DNNs. On average, CREW provides 2.61x speedup and 2.42x energy savings over a TPU like accelerator. Compared to UCNN, a state of art computation reuse technique, CREW achieves 2.10x speedup and 2.08x energy savings on average.


Structured condition numbers for the total least squares problem with linear equality constraint and their statistical estimation. In this paper, we derive the mixed and componentwise condition numbers for a linear function of the solution to the total least squares with linear equality constraint (TLSE) problem. The explicit expressions of the mixed and componentwise condition numbers by dual techniques under both unstructured and structured componentwise perturbations is considered. With the intermediate result, i.e. we can recover the both unstructured and structured condition number for the TLS problem. We choose the small sample statistical condition estimation method to estimate both unstructured and structured condition numbers with high reliability. Numerical experiments are provided to illustrate the obtained results.


Partitions of the complete hypergraph K 6 3 and a determinant like function. In this paper we introduce a determinant like map det S 3 and study some of its properties. For this we define a graded vector space Lambda S 3 V that has similar properties with the exterior algebra Lambda V and the exterior GSC operad Lambda S 2 V from cite sta2 . When dim(V 2) 2 we show that dim k( Lambda S 3 V 2 6 ) 1 which gives the existence and uniqueness of det S 3 . We also give an explicit formula for det S 3 as a sum over certain 2 partitions of the complete hypergraph K 6 3 .


Stable graphs of bounded twin width. We prove that every class of graphs mathscr C that is monadically stable and has bounded twin width can be transduced from some class with bounded sparse twin width. This generalizes analogous results for classes of bounded linear cliquewidth and of bounded cliquewidth. It also implies that monadically stable classes of bounded twin widthare linearly chi bounded.


Gaussian bounds of fundamental matrix and maximal L 1 regularity for Lam ' e system with rough coefficients. The purpose of this paper is twofold. First, we use a classical method to establish Gaussian bounds of the fundamental matrix of a generalized parabolic Lam ' e system with only bounded and measurable coefficients. Second, we derive a maximal L 1 regularity result for the abstract Cauchy problem associated with a composite operator. In a concrete example, we also obtain maximal L 1 regularity for the Lam ' e system, from which it follows that the Lipschitz seminorm of the solutions to the Lam ' e system is globally L 1 in time integrable. As an application, we use a Lagrangian approach to prove a global in time well posedness result for a viscous pressureless flow provided that the initial velocity satisfies a scaling invariant smallness condition. The method established in this paper might be a powerful tool for studying many issues arising from viscous fluids with truly variable densities.


Performance comparison of CFD DEM solver MFiX Exa, on GPUs and CPUs. We present computational performance comparisons of gas solid simulations performed on current CPU and GPU architectures using MFiX Exa, a CFD DEM solver that leverages hybrid CPU GPU parallelism. A representative fluidized bed simulation with varying particle numbers from 2 to 67 million is used to compare serial and parallel performance. A single GPU was observed to be about 10 times faster compared to a single CPU core. The use of 3 GPUs on a single compute node was observed to be 4x faster than using all 64 CPU cores. We also observed that using an error controlled adaptive time stepping scheme for particle advance provided a consistent 4x speed up on both CPUs and GPUs. Weak scaling results indicate superior parallel efficiencies when using GPUs compared to CPUs for the problem sizes studied in this work.


Mobile defects born from an energy cascade shape the locomotive behavior of a headless animal. The physics of behavior seeks simple descriptions of animal behavior. The field has advanced rapidly by using techniques in low dimensional dynamics distilled from computer vision. Yet, we still do not generally understand the rules which shape these emergent behavioral manifolds in the face of complicated neuro construction even in the simplest of animals. In this work, we introduce a non neuromuscular model system which is complex enough to teach us something new but also simple enough for us to understand. In this simple animal, the manifolds underlying the governing dynamics are shaped and stabilized by a physical mechanism an active elastic, inverse energy cascade. Building upon pioneering work in the field, we explore the formulation of the governing dynamics of a polarized active elastic sheet in terms of the normal modes of an elastic structure decorated by a polarized activity at every node. By incorporating a torque mediated coupling physics, we show that power is pumped from the shortest length scale up to longer length scale modes via a combination of direct mode coupling and preferential dissipation. We use this result to motivate the study of organismal locomotion as an emergent simplicity governing organism scale behavior. To master the low dimensional dynamics on this manifold, we present a zero transients limit study of the dynamics of 1 or vortex like defects in the ciliary field. We show, experimentally, numerically and analytically that these defects arise from this energy cascade to generate long lived, stable modes of locomotive behavior. Using a geometric model, we can link defects to organism locomotion. We extend this framework to study larger organisms with non circular shape and introduce local activity modulation for defect steering. We expect this work to inform the foundations of organismal control of distributed actuation without muscles or neurons.


Using Single Trial Representational Similarity Analysis with EEG to track semantic similarity in emotional word processing. Electroencephalography (EEG) is a powerful non invasive brain imaging technique with a high temporal resolution that has seen extensive use across multiple areas of cognitive science research. This thesis adapts representational similarity analysis (RSA) to single trial EEG datasets and introduces its principles to EEG researchers unfamiliar with multivariate analyses. We have two separate aims 1. we want to explore the effectiveness of single trial RSA on EEG datasets 2. we want to utilize single trial RSA and computational semantic models to investigate the role of semantic meaning in emotional word processing. We report two primary findings 1. single trial RSA on EEG datasets can produce meaningful and interpretable results given a high number of trials and subjects 2. single trial RSA reveals that emotional processing in the 500 800ms time window is associated with additional semantic analysis.


WheatNet A Lightweight Convolutional Neural Network for High throughput Image based Wheat Head Detection and Counting. For a globally recognized planting breeding organization, manually recorded field observation data is crucial for plant breeding decision making. However, certain phenotypic traits such as plant color, height, kernel counts, etc. can only be collected during a specific time window of a crop's growth cycle. Due to labor intensive requirements, only a small subset of possible field observations are recorded each season. To help mitigate this data collection bottleneck in wheat breeding, we propose a novel deep learning framework to accurately and efficiently count wheat heads to aid in the gathering of real time data for decision making. We call our model WheatNet and show that our approach is robust and accurate for a wide range of environmental conditions of the wheat field. WheatNet uses a truncated MobileNetV2 as a lightweight backbone feature extractor which merges feature maps with different scales to counter image scale variations. Then, extracted multi scale features go to two parallel sub networks for simultaneous density based counting and localization tasks. Our proposed method achieves an MAE and RMSE of 3.85 and 5.19 in our wheat head counting task, respectively, while having significantly fewer parameters when compared to other state of the art methods. Our experiments and comparisons with other state of the art methods demonstrate the superiority and effectiveness of our proposed method.


Wavelet Analysis of Dengue Incidence and its Correlation with Weather and Vegetation Variables in Costa Rica. Dengue represents a serious public health problem in tropical and subtropical regions worldwide. The number of dengue cases and its geographical expansion has increased in recent decades, driven mostly after by social and environmental factors. In Costa Rica, it has been endemic since it was first introduced in 1993. In this article, wavelet analyzes (wavelet power spectrum and wavelet coherence) were performed to detect and quantify dengue periodicity and describe patterns of synchrony between dengue incidence and climatic and environmental factors Normalized Difference Water Index, Enhanced Vegetation Index, Normalized Difference Vegetation Index, Tropical North Atlantic indices, Land Surface Temperature, and El Ni no Southern Oscillation indices in 32 different cantons, using dengue surveillance from 2000 to 2019. Results showed that the dengue dominant cycles are in periods of 1, 2, and 3 years. The wavelet coherence analysis showed that the vegetation indices are correlated with dengue incidence in places located in the central and Northern Pacific of the country in the period of 1 year. Climatic variables such as El Ni no 3, 3.4, 4, showed a strong correlation with dengue incidence in the period of 3 years and the Tropical North Atlantic is correlated with dengue incidence in the period of 1 year. Land Surface Temperature showed a strong correlation with dengue time series in the 32 cantons.


Starlink A Solution to the Digital Connectivity Divide in Education in the Global South. Digital connectivity gap in the global south hampered the education of millions of school children during the COVID 19 pandemic. If not actions are taken to remedy this problem, future prospects of millions of children around will be bleak. This paper explores the feasibility of using the SpaceX Starlink satellite constellation as a means to alleviate the problem of the digital connectivity divide in the global south. First, the paper discusses the issues of digital connectivity in education in rural Sri Lanka and other countries in the global south. Then, the paper gives an introduction to Starlink broadband internet technology and discusses its advantages over traditional technologies. After that, the paper discusses a possible mechanism of adopting Starlink technology as a solution to the rural digital connectivity problem in the global south. Technological, as well as economical aspects of such scheme, are discussed. Finally, challenges that may arise in deploying a system such as Starlink to improve rural digital connectivity in Sri Lanka or any another country in the global south will be discussed with possible remedies.


On the Efficiency of Subclass Knowledge Distillation in Classification Tasks. This work introduces a novel knowledge distillation framework for classification tasks where information on existing subclasses is available and taken into consideration. In classification tasks with a small number of classes or binary detection (two classes) the amount of information transferred from the teacher to the student network is restricted, thus limiting the utility of knowledge distillation. Performance can be improved by leveraging information about possible subclasses within the available classes in the classification task. To that end, we propose the so called Subclass Knowledge Distillation (SKD) framework, which is the process of transferring the subclasses' prediction knowledge from a large teacher model into a smaller student one. Through SKD, additional meaningful information which is not in the teacher's class logits but exists in subclasses (e.g., similarities inside classes) will be conveyed to the student and boost its performance. Mathematically, we measure how many extra information bits the teacher can provide for the student via SKD framework. The framework developed is evaluated in clinical application, namely colorectal polyp binary classification. In this application, clinician provided annotations are used to define subclasses based on the annotation label's variability in a curriculum style of learning. A lightweight, low complexity student trained with the proposed framework achieves an F1 score of 85.05 , an improvement of 2.14 and 1.49 gain over the student that trains without and with conventional knowledge distillation, respectively. These results show that the extra subclasses' knowledge (i.e., 0.4656 label bits per training sample in our experiment) can provide more information about the teacher generalization, and therefore SKD can benefit from using more information to increase the student performance.


Continual Neural Mapping Learning An Implicit Scene Representation from Sequential Observations. Recent advances have enabled a single neural network to serve as an implicit scene representation, establishing the mapping function between spatial coordinates and scene properties. In this paper, we make a further step towards continual learning of the implicit scene representation directly from sequential observations, namely Continual Neural Mapping. The proposed problem setting bridges the gap between batch trained implicit neural representations and commonly used streaming data in robotics and vision communities. We introduce an experience replay approach to tackle an exemplary task of continual neural mapping approximating a continuous signed distance function (SDF) from sequential depth images as a scene geometry representation. We show for the first time that a single network can represent scene geometry over time continually without catastrophic forgetting, while achieving promising trade offs between accuracy and efficiency.


Generalizable Representation Learning for Mixture Domain Face Anti Spoofing. Face anti spoofing approach based on domain generalization(DG) has drawn growing attention due to its robustness forunseen scenarios. Existing DG methods assume that the do main label is known.However, in real world applications, thecollected dataset always contains mixture domains, where thedomain label is unknown. In this case, most of existing meth ods may not work. Further, even if we can obtain the domainlabel as existing methods, we think this is just a sub optimalpartition. To overcome the limitation, we propose domain dy namic adjustment meta learning (D2AM) without using do main labels, which iteratively divides mixture domains viadiscriminative domain representation and trains a generaliz able face anti spoofing with meta learning. Specifically, wedesign a domain feature based on Instance Normalization(IN) and propose a domain representation learning module(DRLM) to extract discriminative domain features for cluster ing. Moreover, to reduce the side effect of outliers on cluster ing performance, we additionally utilize maximum mean dis crepancy (MMD) to align the distribution of sample featuresto a prior distribution, which improves the reliability of clus tering. Extensive experiments show that the proposed methodoutperforms conventional DG based face anti spoofing meth ods, including those utilizing domain labels. Furthermore, weenhance the interpretability through visualizatio


General purpose preconditioning for regularized interior point methods. In this paper we present general purpose preconditioners for regularized augmented systems arising from optimization problems, and their corresponding normal equations. We discuss positive definite preconditioners, suitable for CG and MINRES. We consider "sparsifications" which avoid situations in which eigenvalues of the preconditioned matrix may become complex. Special attention is given to systems arising from the application of regularized interior point methods to linear or nonlinear convex programming problems.


Rigidity for circle diffeomorphisms with breaks satisfying a Zygmund smoothness condition. Let f and tilde f be two circle diffeomorphisms with a break point, with the same irrational rotation number of bounded type, the same size of the break c and satisfying a certain Zygmund type smoothness condition depending on a parameter gamma 2. We prove that under a certain condition imposed on the break size c , the diffeomorphisms f and tilde f are C 1 omega gamma smoothly conjugate to each other, where omega gamma ( delta) log delta ( gamma 2 1) .


Wasserstein Unsupervised Reinforcement Learning. Unsupervised reinforcement learning aims to train agents to learn a handful of policies or skills in environments without external reward. These pre trained policies can accelerate learning when endowed with external reward, and can also be used as primitive options in hierarchical reinforcement learning. Conventional approaches of unsupervised skill discovery feed a latent variable to the agent and shed its empowerment on agent's behavior by mutual information (MI) maximization. However, the policies learned by MI based methods cannot sufficiently explore the state space, despite they can be successfully identified from each other. Therefore we propose a new framework Wasserstein unsupervised reinforcement learning (WURL) where we directly maximize the distance of state distributions induced by different policies. Additionally, we overcome difficulties in simultaneously training N(N 2) policies, and amortizing the overall reward to each step. Experiments show policies learned by our approach outperform MI based methods on the metric of Wasserstein distance while keeping high discriminability. Furthermore, the agents trained by WURL can sufficiently explore the state space in mazes and MuJoCo tasks and the pre trained policies can be applied to downstream tasks by hierarchical learning.


Harmonic maps between 2 dimensional simplicial complexes 2. We study metrics on two dimensional simplicial complexes that are conformal either to flat Euclidean metrics or to the ideal hyperbolic metrics described by Charitos and Papadopoulos. Extending the results of our previous paper, we prove existence, uniqueness, and regularity results for harmonic maps between two such metrics on a complex.


The structure of global conservation laws in Galerkin plasma models. Plasmas are highly nonlinear and multi scale, motivating a hierarchy of models to understand and describe their behavior. However, there is a scarcity of plasma models of lower fidelity than magnetohydrodynamics (MHD). Galerkin models, obtained by projection of the MHD equations onto a truncated modal basis, can furnish this gap in the lower levels of the model hierarchy. In the present work, we develop low dimensional Galerkin plasma models which preserve global conservation laws by construction. This additional model structure enables physics constrained machine learning algorithms that can discover these types of low dimensional plasma models directly from data. This formulation relies on an energy based inner product which takes into account all of the dynamic variables. The theoretical results here build a bridge to the extensive Galerkin literature in fluid mechanics, and facilitate the development of physics constrained reduced order models from plasma data.


Balancing Garbage Collection vs I O Amplification using hybrid Key Value Placement in LSM based Key Value Stores. Key value (KV) separation is a technique that introduces randomness in the I O access patterns to reduce I O amplification in LSM based key value stores for fast storage devices (NVMe). KV separation has a significant drawback that makes it less attractive Delete and especially update operations that are important in modern workloads result in frequent and expensive garbage collection (GC) in the value log. In this paper, we design and implement Parallax, which proposes hybrid KV placement that reduces GC overhead significantly and maximizes the benefits of using a log. We first model the benefits of KV separation for different KV pair sizes. We use this model to classify KV pairs in three categories small, medium, and large. Then, Parallax uses different approaches for each KV category It always places large values in a log and small values in place. For medium values it uses a mixed strategy that combines the benefits of using a log and eliminates GC overhead as follows It places medium values in a log for all but the last few (typically one or two) levels in the LSM structure, where it performs a full compaction, merges values in place, and reclaims log space without the need for GC. We evaluate Parallax against RocksDB that places all values in place and BlobDB that always performs KV separation. We find that Parallax increases throughput by up to 12.4x and 17.83x, decreases I O amplification by up to 27.1x and 26x, and increases CPU efficiency by up to 18.7x and 28x respectively, for all but scan based YCSB workloads.


Contrastive Reinforcement Learning of Symbolic Reasoning Domains. Abstract symbolic reasoning, as required in domains such as mathematics and logic, is a key component of human intelligence. Solvers for these domains have important applications, especially to computer assisted education. But learning to solve symbolic problems is challenging for machine learning algorithms. Existing models either learn from human solutions or use hand engineered features, making them expensive to apply in new domains. In this paper, we instead consider symbolic domains as simple environments where states and actions are given as unstructured text, and binary rewards indicate whether a problem is solved. This flexible setup makes it easy to specify new domains, but search and planning become challenging. We introduce four environments inspired by the Mathematics Common Core Curriculum, and observe that existing Reinforcement Learning baselines perform poorly. We then present a novel learning algorithm, Contrastive Policy Learning (ConPoLe) that explicitly optimizes the InfoNCE loss, which lower bounds the mutual information between the current state and next states that continue on a path to the solution. ConPoLe successfully solves all four domains. Moreover, problem representations learned by ConPoLe enable accurate prediction of the categories of problems in a real mathematics curriculum. Our results suggest new directions for reinforcement learning in symbolic domains, as well as applications to mathematics education.


Classic versus deep learning approaches to address computer vision challenges. Computer vision and image processing address many challenging applications. While the last decade has seen deep neural network architectures revolutionizing those fields, early methods relied on 'classic', i.e., non learned approaches. In this study, we explore the differences between classic and deep learning (DL) algorithms to gain new insight regarding which is more suitable for a given application. The focus is on two challenging ill posed problems, namely faint edge detection and multispectral image registration, studying recent state of the art DL and classic solutions. While those DL algorithms outperform classic methods in terms of accuracy and development time, they tend to have higher resource requirements and are unable to perform outside their training space. Moreover, classic algorithms are more transparent, which facilitates their adoption for real life applications. As both classes of approaches have unique strengths and limitations, the choice of a solution is clearly application dependent.


Optical Absorption and Photocurrent Spectroscopy for Investigating Important Length Scales in Molecular Electronics. We report the optical absorption characteristics and the photocurrent spectra for large area molecular junctions containing different molecular structures and thicknesses. Through experimental assessment of the optical absorption of molecules in solution and chemisorbed onto transparent, conductive carbon films, the energy ranges and intensity of absorption for a variety of molecular layers as a function of thickness were determined. Our findings show that optical absorption is red shifted for a chemisorbed molecular layer relative to the molecule in solution, indicating electronic coupling between the molecule and the surface. However, we also find that from 2 22 nm in thickness, the absorption characteristics follow Beers law, with no further shifts in the wavelength of maximum absorption or low energy absorption onset. For energies where no absorption occurs, an internal photoemission process takes place resulting in photocurrent that can be sustained over a limited range. For energies at which the molecular component absorbs light, photocurrent can proceed over longer distances, and the trends in photocurrent yield versus thickness shows interesting trends that may be related to the distance scale over which charge carriers can communicate with the conductive contacts. This method is particularly relevant for strongly coupled systems that rely on molecular properties to mediate charge transport, since excitation takes place directly within the molecular layer, and provides a direct probe of energetics in systems that show bulk limited transport.


EmgAuth Unlocking Smartphones with EMG Signals. Screen lock is a critical security feature for smartphones to prevent unauthorized access. Although various screen unlocking technologies, including fingerprint and facial recognition, have been widely adopted, they still have some limitations. For example, fingerprints can be stolen by special material stickers and facial recognition systems can be cheated by 3D printed head models. In this paper, we propose EmgAuth, a novel electromyography(EMG) based smartphone unlocking system based on the Siamese network. EmgAuth enables users to unlock their smartphones by leveraging the EMG data of the smartphone users collected from Myo armbands. When training the Siamese network, we design a special data augmentation technique to make the system resilient to the rotation of the armband, which makes EmgAuth free of calibration. We conduct extensive experiments including 53 participants and the evaluation results verify that EmgAuth can effectively authenticate users with an average true acceptance rate of 91.81 while keeping the average false acceptance rate of 7.43 . In addition, we also demonstrate that EmgAuth can work well for smartphones with different screen sizes and for different scenarios when users are placing smartphones at different locations and with different orientations. EmgAuth shows great promise to serve as a good supplement for existing screen unlocking systems to improve the safety of smartphones.


Topology Optimization for Large Scale Additive Manufacturing Generating designs tailored to the deposition nozzle size. Additive Manufacturing (AM) processes intended for large scale components deposit large volumes of material to shorten process duration. This reduces the resolution of the AM process, which is typically defined by the size of the deposition nozzle. If the resolution limitation is not considered when designing for Large Scale Additive Manufacturing (LSAM), difficulties can arise in the manufacturing process, which may require the adaptation of the deposition parameters. This work incorporates the nozzle size constraint into Topology Optimization (TO) in order to generate optimized designs suitable to the process resolution. This article proposes and compares two methods, which are based on existing TO techniques that enable control of minimum and maximum member size, and of minimum cavity size. The first method requires the minimum and maximum member size to be equal to the deposition nozzle size, thus design features of uniform width are obtained in the optimized design. The second method defines the size of the solid members sufficiently small for the resulting structure to resemble a structural skeleton, which can be interpreted as the deposition path. Through filtering and projection techniques, the thin structures are thickened according to the chosen nozzle size. Thus, a topology tailored to the size of the deposition nozzle is obtained along with a deposition proposal. The methods are demonstrated and assessed using 2D and 3D benchmark problems.


Differential Invariants. Validation is a major challenge in differentiable programming. The state of the art is based on algorithmic differentiation. Consistency of first order tangent and adjoint programs is defined by a well known first order differential invariant. This paper generalizes the approach through derivation of corresponding differential invariants of arbitrary order.


Intriguing Usage of Applicability Domain Lessons from Cheminformatics Applied to Adversarial Learning. Defending machine learning models from adversarial attacks is still a challenge none of the robust models is utterly immune to adversarial examples to date. Different defences have been proposed however, most of them are tailored to particular ML models and adversarial attacks, therefore their effectiveness and applicability are strongly limited. A similar problem plagues cheminformatics Quantitative Structure Activity Relationship (QSAR) models struggle to predict biological activity for the entire chemical space because they are trained on a very limited amount of compounds with known effects. This problem is relieved with a technique called Applicability Domain (AD), which rejects the unsuitable compounds for the model. Adversarial examples are intentionally crafted inputs that exploit the blind spots which the model has not learned to classify, and adversarial defences try to make the classifier more robust by covering these blind spots. There is an apparent similarity between AD and adversarial defences. Inspired by the concept of AD, we propose a multi stage data driven defence that is testing for Applicability abnormal values, namely inputs not compliant with the intended use case of the model Reliability samples far from the training data and Decidability samples whose predictions contradict the predictions of their neighbours.It can be applied to any classification model and is not limited to specific types of adversarial attacks. With an empirical analysis, this paper demonstrates how Applicability Domain can effectively reduce the vulnerability of ML models to adversarial examples.


Geometric Deep Learning on Molecular Representations. Geometric deep learning (GDL), which is based on neural network architectures that incorporate and process symmetry information, has emerged as a recent paradigm in artificial intelligence. GDL bears particular promise in molecular modeling applications, in which various molecular representations with different symmetry properties and levels of abstraction exist. This review provides a structured and harmonized overview of molecular GDL, highlighting its applications in drug discovery, chemical synthesis prediction, and quantum chemistry. Emphasis is placed on the relevance of the learned molecular features and their complementarity to well established molecular descriptors. This review provides an overview of current challenges and opportunities, and presents a forecast of the future of GDL for molecular sciences.


Expressing and Executing Informed Consent Permissions Using SWRL The All of Us Use Case. The informed consent process is a complicated procedure involving permissions as well a variety of entities and actions. In this paper, we discuss the use of Semantic Web Rule Language (SWRL) to further extend the Informed Consent Ontology (ICO) to allow for semantic machine based reasoning to manage and generate important permission based information that can later be viewed by stakeholders. We present four use cases of permissions from the All of Us informed consent document and translate these permissions into SWRL expressions to extend and operationalize ICO. Our efforts show how SWRL is able to infer some of the implicit information based on the defined rules, and demonstrate the utility of ICO through the use of SWRL extensions. Future work will include developing formal and generalized rules and expressing permissions from the entire document, as well as working towards integrating ICO into software systems to enhance the semantic representation of informed consent for biomedical research.


Typical Lipschitz mappings are typically non differentiable. We prove that a typical Lipschitz mapping between any two Banach spaces is non differentiable at typical points of any given subset of its domain in the most extreme form. This is a new result even for Lipschitz mappings between Euclidean spaces.


C 3Net End to End deep learning for efficient real time visual active camera control. The need for automated real time visual systems in applications such as smart camera surveillance, smart environments, and drones necessitates the improvement of methods for visual active monitoring and control. Traditionally, the active monitoring task has been handled through a pipeline of modules such as detection, filtering, and control. However, such methods are difficult to jointly optimize and tune their various parameters for real time processing in resource constraint systems. In this paper a deep Convolutional Camera Controller Neural Network is proposed to go directly from visual information to camera movement to provide an efficient solution to the active vision problem. It is trained end to end without bounding box annotations to control a camera and follow multiple targets from raw pixel values. Evaluation through both a simulation framework and real experimental setup, indicate that the proposed solution is robust to varying conditions and able to achieve better monitoring performance than traditional approaches both in terms of number of targets monitored as well as in effective monitoring time. The advantage of the proposed approach is that it is computationally less demanding and can run at over 10 FPS ( 4x speedup) on an embedded smart camera providing a practical and affordable solution to real time active monitoring.


Global and Local Alignment Networks for Unpaired Image to Image Translation. The goal of unpaired image to image translation is to produce an output image reflecting the target domain's style while keeping unrelated contents of the input source image unchanged. However, due to the lack of attention to the content change in existing methods, the semantic information from source images suffers from degradation during translation. In the paper, to address this issue, we introduce a novel approach, Global and Local Alignment Networks (GLA Net). The global alignment network aims to transfer the input image from the source domain to the target domain. To effectively do so, we learn the parameters (mean and standard deviation) of multivariate Gaussian distributions as style features by using an MLP Mixer based style encoder. To transfer the style more accurately, we employ an adaptive instance normalization layer in the encoder, with the parameters of the target multivariate Gaussian distribution as input. We also adopt regularization and likelihood losses to further reduce the domain gap and produce high quality outputs. Additionally, we introduce a local alignment network, which employs a pretrained self supervised model to produce an attention map via a novel local alignment loss, ensuring that the translation network focuses on relevant pixels. Extensive experiments conducted on five public datasets demonstrate that our method effectively generates sharper and more realistic images than existing approaches. Our code is available at https github.com ygjwd12345 GLANet.


Restricted Grassmannian permutations. A permutation is called Grassmannian if it has at most one descent. In this paper, we investigate pattern avoidance and parity restrictions for such permutations. As our main result, we derive formulas for the enumeration of Grassmannian permutations that avoid a classical pattern of arbitrary size. In addition, for patterns of the form k12 cdots(k 1) and 23 cdots k1 , we provide combinatorial interpretations in terms of Dyck paths, and for 35124 avoiding Grassmannian permutations, we give an explicit bijection to certain pattern avoiding Schr "oder paths. Finally, we enumerate the subsets of odd and even permutations and discuss properties of their corresponding Dyck paths.


Onboarding in Software Product Lines ConceptMaps as Welcome Guides. With a volatile labour and technological market, onboarding is becoming increasingly important. The process of incorporating a new developer, a.k.a. the newcomer, into a software development team is reckoned to be lengthy, frustrating and expensive. Newcomers face personal, interpersonal, process and technical barriers during their incorporation, which, in turn, affects the overall productivity of the whole team. This problem exacerbates for Software Product Lines (SPLs), where their size and variability combine to make onboarding even more challenging, even more so for developers that are transferred from the Application Engineering team into the Domain Engineering team, who will be our target newcomers. This work presents concept maps on the role of sensemaking scaffolds to help to introduce these newcomers into the SPL domain. Concept maps, used as knowledge visualisation tools, have been proven to be helpful for meaningful learning. Our main insight is to capture concepts of the SPL domain and their interrelationships in a concept map, and then, present them incrementally, helping newcomers grasp the SPL and aiding them in exploring it in a guided manner while avoiding information overload. This work's contributions are four fold. First, concept maps are proposed as a representation to introduce newcomers into the SPL domain. Second, concept maps are presented as the means for a guided exploration of the SPL core assets. Third, a feature driven concept map construction process is introduced. Last, the usefulness of concept maps as guides for SPL onboarding is tested through a formative evaluation. Link to the online demo url "https rebrand.ly wacline cmap"


physics.optics cs.CV cs.NE physics.app-ph

Classification and reconstruction of spatially overlapping phase images using diffractive optical networks. Diffractive optical networks unify wave optics and deep learning to all optically compute a given machine learning or computational imaging task as the light propagates from the input to the output plane. Here, we report the design of diffractive optical networks for the classification and reconstruction of spatially overlapping, phase encoded objects. When two different phase only objects spatially overlap, the individual object functions are perturbed since their phase patterns are summed up. The retrieval of the underlying phase images from solely the overlapping phase distribution presents a challenging problem, the solution of which is generally not unique. We show that through a task specific training process, passive diffractive networks composed of successive transmissive layers can all optically and simultaneously classify two different randomly selected, spatially overlapping phase images at the input. After trained with 550 million unique combinations of phase encoded handwritten digits from the MNIST dataset, our blind testing results reveal that the diffractive network achieves an accuracy of 85.8 for all optical classification of two overlapping phase images of new handwritten digits. In addition to all optical classification of overlapping phase objects, we also demonstrate the reconstruction of these phase images based on a shallow electronic neural network that uses the highly compressed output of the diffractive network as its input (with e.g., 20 65 times less number of pixels) to rapidly reconstruct both of the phase images, despite their spatial overlap and related phase ambiguity. The presented phase image classification and reconstruction framework might find applications in e.g., computational imaging, microscopy and quantitative phase imaging fields.


The influence of cations on the dipole moments of neighboring polar molecules. It is shown that the dipole moment of polar (water, methanol, formamide, acetone and acetonitrile) molecules in the neighborhood of a cation is increased primarily by polarization from the bare electrostatic charge of the cation, although the effective value of the latter is somewhat reduced by "back donation" of electrons from neighbouring polar molecules. In other words, the classical picture may be viewed as if a point charge slightly smaller than the nominal charge of the cation would be placed at the cation site. It was found that the geometrical arrangement of the polar molecules in the first solvation shell is such that their mutual polarization reduces the dipole moments of individual molecules, so that in some cases they become smaller than the dipole moment of the free protic or aprotic molecule. We conjecture that this behavior is essentially a manifestation of the Le Chatellier Braun principle.


Adversarial Attacks for Tabular Data Application to Fraud Detection and Imbalanced Data. Guaranteeing the security of transactional systems is a crucial priority of all institutions that process transactions, in order to protect their businesses against cyberattacks and fraudulent attempts. Adversarial attacks are novel techniques that, other than being proven to be effective to fool image classification models, can also be applied to tabular data. Adversarial attacks aim at producing adversarial examples, in other words, slightly modified inputs that induce the Artificial Intelligence (AI) system to return incorrect outputs that are advantageous for the attacker. In this paper we illustrate a novel approach to modify and adapt state of the art algorithms to imbalanced tabular data, in the context of fraud detection. Experimental results show that the proposed modifications lead to a perfect attack success rate, obtaining adversarial examples that are also less perceptible when analyzed by humans. Moreover, when applied to a real world production system, the proposed techniques shows the possibility of posing a serious threat to the robustness of advanced AI based fraud detection procedures.


Existence of solution for Schr "odinger equation with discontinuous nonlinearity and critical Growth. This paper concerns with the existence of nontrivial solution for the following problem begin equation left begin aligned Delta u V(x)u gamma H e ( u a) u q 2 u u 2 2 u mbox in mathbb R N , nonumber u in H 1 ( mathbb R N ). end aligned right. end equation where, N geq 3 , gamma geq 0 , H e mathbb R to mathbb R denotes the Heaviside function, a geq 0 , 2 q 2 and V mathbb R N to mathbb R is mathbb Z N periodic with beta 0 does not belong to the spectrum of Delta V .


Exponential convergence to equilibrium for coupled systems of nonlinear degenerate drift diffusion equations. We study the existence and long time asymptotics of weak solutions to a system of two nonlinear drift diffusion equations that has a gradient flow structure in the Wasserstein distance. The two equations are coupled through a cross diffusion term that is scaled by a parameter varepsilon ge0 . The nonlinearities and potentials are chosen such that in the decoupled system for varepsilon 0 , the evolution is metrically contractive, with a global rate Lambda 0 . The coupling is a singular perturbation in the sense that for any varepsilon 0 , contractivity of the system is lost. Our main result is that for all sufficiently small varepsilon 0 , the global attraction to a unique steady state persists, with an exponential rate Lambda varepsilon Lambda K varepsilon . The proof combines results from the theory of metric gradient flows with further variational methods and functional inequalities.


Estimates on some functionals over non linear resolvents. Estimation of linear and quadratic functionals over different classes of univalent functions is one of the classical problems in geometric function theory. In this paper we solve the problem over some classes of so called non linear resolvents, which arise as a fruitful tool in dynamic systems. Sharp estimates on early Taylor coefficients and the Fekete Szeg " o functional are established.


Filling gaps in trustworthy development of AI. The range of application of artificial intelligence (AI) is vast, as is the potential for harm. Growing awareness of potential risks from AI systems has spurred action to address those risks, while eroding confidence in AI systems and the organizations that develop them. A 2019 study found over 80 organizations that published and adopted "AI ethics principles'', and more have joined since. But the principles often leave a gap between the "what" and the "how" of trustworthy AI development. Such gaps have enabled questionable or ethically dubious behavior, which casts doubts on the trustworthiness of specific organizations, and the field more broadly. There is thus an urgent need for concrete methods that both enable AI developers to prevent harm and allow them to demonstrate their trustworthiness through verifiable behavior. Below, we explore mechanisms (drawn from arXiv 2004.07213) for creating an ecosystem where AI developers can earn trust if they are trustworthy. Better assessment of developer trustworthiness could inform user choice, employee actions, investment decisions, legal recourse, and emerging governance regimes.


Coloured and Semi Transparent Nanowire based Solar Cells for Building Integrated Photovoltaics. Semi transparent photovoltaics (ST PV) provide smart spatial solutions to integrate solar cells into already built areas. Here, we study the potential of semiconductor nanowires (NWs) as promising ST PV. We perform FDTD simulations for different PV materials in a wide range of array geometries, from which we compute PV performance next to perceived appearance. Surprisingly we find an unusual compromise between photocurrent and transmittance as a function of NW diameter that enables NW based PV to outperform theoretical limits of non wavelength selective ST PV. We theoretically and experimentally demonstrate the robustness of NW arrays to different illumination conditions. We provide the origin behind the outperforming NW array geometries, which is crucial for designing NW based ST PV systems based on specific needs.


Goldilocks Consistent Crowdsourced Scalar Annotations with Relative Uncertainty. Human ratings have become a crucial resource for training and evaluating machine learning systems. However, traditional elicitation methods for absolute and comparative rating suffer from issues with consistency and often do not distinguish between uncertainty due to disagreement between annotators and ambiguity inherent to the item being rated. In this work, we present Goldilocks, a novel crowd rating elicitation technique for collecting calibrated scalar annotations that also distinguishes inherent ambiguity from inter annotator disagreement. We introduce two main ideas grounding absolute rating scales with examples and using a two step bounding process to establish a range for an item's placement. We test our designs in three domains judging toxicity of online comments, estimating satiety of food depicted in images, and estimating age based on portraits. We show that (1) Goldilocks can improve consistency in domains where interpretation of the scale is not universal, and that (2) representing items with ranges lets us simultaneously capture different sources of uncertainty leading to better estimates of pairwise relationship distributions.


Efficient Neural Network Training via Forward and Backward Propagation Sparsification. Sparse training is a natural idea to accelerate the training speed of deep neural networks and save the memory usage, especially since large modern neural networks are significantly over parameterized. However, most of the existing methods cannot achieve this goal in practice because the chain rule based gradient (w.r.t. structure parameters) estimators adopted by previous methods require dense computation at least in the backward propagation step. This paper solves this problem by proposing an efficient sparse training method with completely sparse forward and backward passes. We first formulate the training process as a continuous minimization problem under global sparsity constraint. We then separate the optimization process into two steps, corresponding to weight update and structure parameter update. For the former step, we use the conventional chain rule, which can be sparse via exploiting the sparse structure. For the latter step, instead of using the chain rule based gradient estimators as in existing methods, we propose a variance reduced policy gradient estimator, which only requires two forward passes without backward propagation, thus achieving completely sparse training. We prove that the variance of our gradient estimator is bounded. Extensive experimental results on real world datasets demonstrate that compared to previous methods, our algorithm is much more effective in accelerating the training process, up to an order of magnitude faster.


SC Reg Training Overparameterized Neural Networks under Self Concordant Regularization. In this paper we propose the SC Reg (self concordant regularization) framework for learning overparameterized feedforward neural networks by incorporating second order information in the emph Newton decrement framework for convex problems. We propose the generalized Gauss Newton with Self Concordant Regularization (SCoRe GGN) algorithm that updates the network parameters each time it receives a new input batch. The proposed algorithm exploits the structure of the second order information in the Hessian matrix, thereby reducing the training computational overhead. Although our current analysis considers only the convex case, numerical experiments show the efficiency of our method and its fast convergence under both convex and non convex settings, which compare favorably against baseline first order methods and a quasi Newton method.


H "older regularity for non variational porous media type equations. We present a Krylov Safonov regularity approach for the H "older regularity of viscosity solutions to non variational porous media type equations


Patch2CAD Patchwise Embedding Learning for In the Wild Shape Retrieval from a Single Image. 3D perception of object shapes from RGB image input is fundamental towards semantic scene understanding, grounding image based perception in our spatially 3 dimensional real world environments. To achieve a mapping between image views of objects and 3D shapes, we leverage CAD model priors from existing large scale databases, and propose a novel approach towards constructing a joint embedding space between 2D images and 3D CAD models in a patch wise fashion establishing correspondences between patches of an image view of an object and patches of CAD geometry. This enables part similarity reasoning for retrieving similar CADs to a new image view without exact matches in the database. Our patch embedding provides more robust CAD retrieval for shape estimation in our end to end estimation of CAD model shape and pose for detected objects in a single input image. Experiments on in the wild, complex imagery from ScanNet show that our approach is more robust than state of the art in real world scenarios without any exact CAD matches.


Design of Experiments with Imputable Feature Data An Entropy Based Approach. Tactical selection of experiments to estimate an underlying model is an innate task across various fields. Since each experiment has costs associated with it, selecting statistically significant experiments becomes necessary. Classic linear experimental design deals with experiment selection so as to minimize (functions of) variance in estimation of regression parameter. Typically, standard algorithms for solving this problem assume that data associated with each experiment is fully known. This isn't often true since missing data is a common problem. For instance, remote sensors often miss data due to poor connection. Hence experiment selection under such scenarios is a widespread but challenging task. Though decoupling the tasks and using standard data imputation methods like matrix completion followed by experiment selection might seem a way forward, they perform sub optimally since the tasks are naturally interdependent. Standard design of experiments is an NP hard problem, and the additional objective of imputing for missing data amplifies the computational complexity. In this paper, we propose a maximum entropy principle based framework that simultaneously addresses the problem of design of experiments as well as the imputation of missing data. Our algorithm exploits homotopy from a suitably chosen convex function to the non convex cost function hence avoiding poor local minima. Further, our proposed framework is flexible to incorporate additional application specific constraints. Simulations on various datasets show improvement in the cost value by over 60 in comparison to benchmark algorithms applied sequentially to the imputation and experiment selection problems.


An SDE Framework for Adversarial Training, with Convergence and Robustness Analysis. Adversarial training has gained great popularity as one of the most effective defenses for deep neural networks against adversarial perturbations on data points. Consequently, research interests have grown in understanding the convergence and robustness of adversarial training. This paper considers the min max game of adversarial training by alternating stochastic gradient descent. It approximates the training process with a continuous time stochastic differential equation (SDE). In particular, the error bound and convergence analysis is established. This SDE framework allows direct comparison between adversarial training and stochastic gradient descent and confirms analytically the robustness of adversarial training from a (new) gradient flow viewpoint. This analysis is then corroborated via numerical studies. To demonstrate the versatility of this SDE framework for algorithm design and parameter tuning, a stochastic control problem is formulated for learning rate adjustment, where the advantage of adaptive learning rate over fixed learning rate in terms of training loss is demonstrated through numerical experiments.


Patch Slimming for Efficient Vision Transformers. This paper studies the efficiency problem for visual transformers by excavating redundant calculation in given networks. The recent transformer architecture has demonstrated its effectiveness for achieving excellent performance on a series of computer vision tasks. However, similar to that of convolutional neural networks, the huge computational cost of vision transformers is still a severe issue. Considering that the attention mechanism aggregates different patches layer by layer, we present a novel patch slimming approach that discards useless patches in a top down paradigm. We first identify the effective patches in the last layer and then use them to guide the patch selection process of previous layers. For each layer, the impact of a patch on the final output feature is approximated and patches with less impact will be removed. Experimental results on benchmark datasets demonstrate that the proposed method can significantly reduce the computational costs of vision transformers without affecting their performances. For example, over 45 FLOPs of the ViT Ti model can be reduced with only 0.2 top 1 accuracy drop on the ImageNet dataset.


Bandit based centralized matching in two sided markets for peer to peer lending. Sequential fundraising in two sided online platforms enable peer to peer lending by sequentially bringing potential contributors, each of whose decisions impact other contributors in the market. However, understanding the dynamics of sequential contributions in online platforms for peer lending has been an open ended research question. The centralized investment mechanism in these platforms makes it difficult to understand the implicit competition that borrowers face from a single lender at any point in time. Matching markets are a model of pairing agents where the preferences of agents from both sides in terms of their preferred pairing for transactions can allow to decentralize the market. We study investment designs in two sided platforms using matching markets when the investors or lenders also face restrictions on the investments based on borrower preferences. This situation creates an implicit competition among the lenders in addition to the existing borrower competition, especially when the lenders are uncertain about their standing in the market and thereby the probability of their investments being accepted or the borrower loan requests for projects reaching the reserve price. We devise a technique based on sequential decision making that allows the lenders to adjust their choices based on the dynamics of uncertainty from competition over time. We simulate two sided market matchings in a sequential decision framework and show the dynamics of the lender regret amassed compared to the optimal borrower lender matching and find that the lender regret depends on the initial preferences set by the lenders which could affect their learning over decision making steps.


Ramification theory of reciprocity sheaves, II, Higher local symbols. We construct a theory of higher local symbols along Parsin chains for reciprocity sheaves. Applying this formalism to differential forms, gives a new construction of the Parsin Lomadze residue maps, and applying it to the torsion characters of the fundamental group gives back the reciprocity map from Kato's higher local class field theory in the geometric case. The higher local symbols satisfy various reciprocity laws. The main result of the paper is a characterization of the modulus attached to a section of a reciprocity sheaf in terms of the higher local symbols.


Prior Signal Editing for Graph Filter Posterior Fairness Constraints. Graph filters are an emerging paradigm that systematizes information propagation in graphs as transformation of prior node values, called graph signals, to posterior scores. In this work, we study the problem of mitigating disparate impact, i.e. posterior score differences between a protected set of sensitive nodes and the rest, while minimally editing scores to preserve recommendation quality. To this end, we develop a scheme that respects propagation mechanisms by editing graph signal priors according to their posteriors and node sensitivity, where a small number of editing parameters can be tuned to constrain or eliminate disparate impact. We also theoretically explain that coarse prior editing can locally optimize posteriors objectives thanks to graph filter robustness. We experiment on a diverse collection of 12 graphs with varying number of nodes, where our approach performs equally well or better than previous ones in minimizing disparate impact and preserving posterior AUC under fairness constraints.


Exploring Knowledge Leakage Risk in Knowledge Intensive Organisations Behavioural aspects and Key controls. Knowledge leakage poses a critical risk to the competitive advantage of knowledge intensive organisations. Although knowledge leakage is a human centric security issue, little is known about leakage resulting from individual behaviour and the protective strategies and controls that could be effective in mitigating leakage risk. Therefore, this research explores the perspectives of security practitioners on the key factors that influence knowledge leakage risk in the context of knowledge intensive organisations. We conduct two focus groups to explore these perspectives. The research highlights three types of behavioural controls that mitigate the risk of knowledge leakage human resource management practices, knowledge security training and awareness practices, and compartmentalisation practices.


Second cohomology groups of the Hopf algebras associated to universal unitary quantum groups. We compute the second (and the first) cohomology groups of algebras associated to the universal quantum unitary groups of not neccesarily Kac type, extending our earlier results for the free unitary group U d . The extended setup forces us to use infinite dimensional representations to construct the cocycles.


Pentadiagonal Matrices and an Application to the Centered MA(1) Stationary Gaussian Process. In this work, we study the properties of a pentadiagonal symmetric matrix with perturbed corners. More specifically, we present explicit expressions for characterizing when this matrix is non negative and positive definite in two special and important cases. We also give a closed expression for the determinant of such matrices. Previous works present the determinant in a recurrence form but not in an explicit one. As an application of these results, we also study the limiting cumulant generating function associated to the bivariate sequence of random vectors (n 1 ( sum k 1 n X k 2 , sum k 2 n X k X k 1 ) n in N , when (X n) n in N is the centered stationary moving average process of first order with Gaussian innovations. We exhibit the explicit expression of this limiting cumulant generating function. Finally, we present three examples illustrating the techniques studied here.


Conforming, nonconforming and DG methods for the stationary generalized Burgers Huxley equation. In this work we address the analysis of the stationary generalized Burgers Huxley equation (a nonlinear elliptic problem with anomalous advection) and propose conforming, nonconforming and discontinuous Galerkin finite element methods for its numerical approximation. The existence, uniqueness and regularity of weak solutions is discussed in detail using a Faedo Galerkin approach and fixed point theory, and a priori error estimates for all three types of numerical schemes are rigorously derived. A set of computational results are presented to show the efficacy of the proposed methods.


Master Face Attacks on Face Recognition Systems. Face authentication is now widely used, especially on mobile devices, rather than authentication using a personal identification number or an unlock pattern, due to its convenience. It has thus become a tempting target for attackers using a presentation attack. Traditional presentation attacks use facial images or videos of the victim. Previous work has proven the existence of master faces, i.e., faces that match multiple enrolled templates in face recognition systems, and their existence extends the ability of presentation attacks. In this paper, we perform an extensive study on latent variable evolution (LVE), a method commonly used to generate master faces. We run an LVE algorithm for various scenarios and with more than one database and or face recognition system to study the properties of the master faces and to understand in which conditions strong master faces could be generated. Moreover, through analysis, we hypothesize that master faces come from some dense areas in the embedding spaces of the face recognition systems. Last but not least, simulated presentation attacks using generated master faces generally preserve the false matching ability of their original digital forms, thus demonstrating that the existence of master faces poses an actual threat.


Distribution and Moments of the Error Term in the Lattice Point Counting Problem for 3 Dimensional Cygan Kor 'anyi Balls. We study fluctuations of the error term for the number of integer lattice points lying inside a 3 dimensional Cygan Kor 'anyi ball of large radius. We prove that the error term, suitably normalized, has a limiting value distribution which is absolutely continuous, and we provide estimates for the decay rate of the corresponding density on the real line. In addition, we establish the existence of all moments for the normalized error term, and we prove that these are given by the moments of the corresponding density.


Tree Based Dynamic Classifier Chains. Classifier chains are an effective technique for modeling label dependencies in multi label classification. However, the method requires a fixed, static order of the labels. While in theory, any order is sufficient, in practice, this order has a substantial impact on the quality of the final prediction. Dynamic classifier chains denote the idea that for each instance to classify, the order in which the labels are predicted is dynamically chosen. The complexity of a naive implementation of such an approach is prohibitive, because it would require to train a sequence of classifiers for every possible permutation of the labels. To tackle this problem efficiently, we propose a new approach based on random decision trees which can dynamically select the label ordering for each prediction. We show empirically that a dynamic selection of the next label improves over the use of a static ordering under an otherwise unchanged random decision tree model. and experimental environment. In addition, we also demonstrate an alternative approach based on extreme gradient boosted trees, which allows for a more target oriented training of dynamic classifier chains. Our results show that this variant outperforms random decision trees and other tree based multi label classification methods. More importantly, the dynamic selection strategy allows to considerably speed up training and prediction.


Nonplanar minimal spheres in ellipsoids of revolution. We use global bifurcation techniques to establish the existence of arbitrarily many geometrically distinct nonplanar embedded smooth minimal 2 spheres in sufficiently elongated 3 dimensional ellipsoids of revolution. More precisely, we quantify the growth rate of the number of such minimal spheres, and describe their asymptotic behavior as the ellipsoids converge to a cylinder.